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JOB TRAINING PARTNERSHIP ACT: JOB COST, 
JOB OUTCOME 



THURSDAY, APRIL 29, 1903 

House of Representatives, 
Employment, Housing, and Avution Subcommittee 

OF the Committee on Government Operations, 

Washington, DC. 

The subcommittee met, pursuant to notice, at 9:40 a.m., in room 
2247, Raybum House Office Building, Hon. Collin C. Peterson 
(chairman of tine subcommittee) presiding. 

Present: Representatives Collin C. Peterson, Bobby L. Rush. 
Floyd H. Flake, Karen L. Thurman, Barbara-Rose Collins, and 
Ronald K Machtley. 

Also present: Edith Holleman, staff director; Andrea Nelson, 
counsel; Lisa Phillips, professional staff member; June Saxton^ 
clerk; and Michael D. Nannini, minority professional staff. Commit- 
tee on Government Operations. 

OPENING STATEMENT OF CHAmMAN PETERSON 

Mr. Peterson. The subcommittee will come to order. This is the 
first in a series of subcommittee hearings into whether the $11 bil- 
lion the Federal Government spends each year on job training pro- 
cprams actually works to improve the lives, levels of earnings, and 
niture employability of the individuals who participate in the pro- 
gprams. 

Our focus today is on the Job Training Partnership Act which, 
at nearly $2 billion per year, is the lain^est single Federal job train- 
ing program. Recent studies of the effectiveness of JTPA conclude 
that standard JTPA pro-ams, with their traditional oriority on 
placing participants in a job — any job — do not have mucn effect on 
the level of earnings or future employability of program partici- 
pants. 

Testifying about their reports today are the Labor Departments 
Office of Inspector General, the General Accounting Office, and 
ABT Associates — a private consultant specifically retained by the 
Labor Department to evaluate the impact of JTPA on program par- 
ticipants. 

We will also hear today from several local private industry coun- 
cils that have moved aggressively to reverse this pattern of mini- 
mal results through innovative strategies such as carefully 
targeting the needs of local employers and coordinating training 
and support services to most effectively benefit program partici- 
pants. They also spend, 1 should note, two to three times more 
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money per participant than the average^ according to the ABT 
study. 

Testimony from the Labor Department will conclude the hearing. 
Top career staff of the Employment Training Administration will 
report on the status of implementation of the reforms enacted in 
the 1992 JTPA amendments and will respond to the criticism 
raised in JTPA studies. 

Do any members have opening statements? Mr. Flake. 

Mr. FiAKE. Just a shoit one, Mr. Chairman. Thank you very 
much. Good morning. % 

First of all, let me thank you for holding the hearing. I think it 
is important, as we consider the plight of many young people 
throughout tnis land, that we have some assessment of tne effec- 
tiveness of the job training program which is aimed at meeting the « 
needs of many disadvantaged youth and adults. 

I would also like to welcome those who come as witnesses this 
morning before this committee and hope that, during the course of 
the hearing, we can get a better understanding of now we might 
better and more effectively serve many of these unemployed youth. 

In particular, I would like to examine whether current progprams 
are successful in increasing employment and increasing the oppor- 
tunities for earnings as weu as the Possibility of getting young peo- 
ple into situations where they can develop the proper work ethic 
and the work discipline that ultimately leads them beyond the 
starter jobs to better jobs. 

The administration has already proposed putting more money 
into this program. It is my hope that, as we put more money into 
the program, we can initially nave a better sense of how the cur- 
rent programs work and how we might better spread those re- 
sources to more effectively impact the job market as a whole. 

We also worJd like some examination of what happens to those 
workers who need the program the most, because there has been 
some accusation that the workers who need the least assistance are 
the most employable, and they receive more benefits sometimes 
from the program than those who do not. I would like to examine 
this inequitv and ensure that the unemployed workers receive the 
assistance tnat they need. 

Again, I would like to thank you for holding this hearing and 
thank those who have come as witnesses and, hopefully, we can all 
work together toward the end of providing better job opportunities 
for all /^erican citizens. * 

Thank you, Mr. Chairman. I vield back. 

Mr. Peterson. Thank you, Mr. Flake. That was a fine statement. 
Mr. Machtley, do you have an opening statement? 

Mr. Machtley. Thank you, Mr. Chairman. I look forward to 
workine with you on this subcommittee as we hear many witnesses 
and look at the issues that are important to this country and par- 
ticularly to our future. 

I waut to thank you for c lling this particular hearing because 
I think that job training is essential for the next decade and prob- 
ably for the long-term future of our Nation. 

I am very much reminded of the booklet recently written by Les- 
ter Thurow, ''Head to Head," which points out that the competition 
is not between our States in the future, but between nations. Those 



who are prepared to compete will be successful. Those who are not 
prepared to compete will, in fact, find their standard of living re- 
duced and, obviously, their wages reduced at the same time. 

Faced with this obvious, daunting national challenge to become 
more productive, I believe cooperation is necessary in all areas of 
education, training, and the continued development of our work 
force. Workers must be committed to high-quality products and 
services. If we do not understand the term "quality today, I am 
afraid that tomorrow will be a disaster. 

Educators must provide our workers with a solid foundation in 
basic skills to enable workers to adapt to changing technologies. 
The most recent issue of Forbes magazine points out that every 
employee is going to change their type of employment perhaps six 
to seven times during their life in the future. 

Employers must invest in work training and coordinate their ac- 
tivities with educators and workers to create mutually beneficial 
partnerships. At this time, the Job Training Partnership Act serves 
as the primary Federal-State program to train and assist individ- 
uals facing various barriers to employment. 

Some barriers can be easily overcome, such as not knowing how 
to conduct a job search. Other barriers, however, require intensive 
and individualized attention, such as lack of basic math and read- 
ing skills. Probably homelessness and welfare dependency are 
going to be more difficult to combat. 

According to figures which we will hear more about in today's 
testimony, approximately 36 million people face some tvpe of em- 
ployment barrier and are eligible to participate in JoD Training 
Partnership Act programs. Tragically, less than 2.5 percent of the 
eligible population is being scared. 

Moving beyond that depressingly low figure, we will also hear 
that, of this 2.5 percent, only two-thirds of the participants are suc- 
cessfully completing their training and finding employment. So we 
have 2.5 percent of the eligible population participating and only 
two-thirds of that 2.5 percent are completing the training and find- 
ing employment. Obviously, we have to assess whether this is a 
successful program and, if not, what should be done. 

The question becomes, how do we best accomplish our mutual 
goals of making us the most productive Nation for the future 
through job training programs. I look forward to hearing the testi- 
mony. 

Mr. Peterson. Thank you, Mr. Machtley. We look forward to 
working with you and the members on your side on this sub- 
committee. Mrs. Thurman, do you have an opening statement? 

Mrs. Thurman. Briefly, Mr. Chairman. I also appreciate the fact 
that you are holding these hearings. As a former member of the co- 
ordinating council in the State of Florida for JTPA, I find this an 
exciting time and certainly one that will renew what I think were 
the objectives for the Job Training Partnership Act. 

I refer to your memo that was sent to Ub, and I specifically hope 
that we look not only at where some problems riddled this program 
but where the successes were, because I think we have some chal- 
lenges for the future for this country based on where our necessary 
retraining programs are going to have to be looked at, particularly 
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with dislocated workers, especially the workers that will be dis- 
placed due to defense spending cuts. 

So I think we have some challenges facing us. However, I think 
this hearing is a step in the right direction. 

Mr. Peterson. Thank you, Mrs. Thurman. 

I would like to now welcome the first panel of witnesses, and I 
would ask that the members reserve their questions until all the 
witnesses have had a chance to speak. 

Mr. Flake. Mr. Chairman, before you do that, may I make a 
unanimous-consent request? 

Mr. Peterson. Sure. 

Mr. Flake. That I be permitted to submit to the committee ques- 
tions. The Banking Committee has the RTC markup at this hour, 
and I would like to go to that, but I would like unanimous consent 
to submit questions. 

Mr. Peterson. Without objection, so ordered. 

Mr. Flake. Thank you. 

Mr. Machtley. Mr. Chairman, if I may, may all members have 
the same opportimity? 

Mr. Peterson. Yes, we will extend that to all members, and if 
any other members have opening statements, we'll make those a 
part of the record as well. 

I would like to call Mr. Charles Masten, the acting inspector gen- 
eral for the Department of Labor, who will be accompanied by Ger- 
ald Peterson, assistant inspector general for audit; and Clarence 
Crawford, the Associate Director of Employment and Education Is- 
sues, Human Resources Division of the GAO, who will be accom- 
panied, as I understand it, by Sigurd Nilsen of the Human Re- 
sources Division; and Larry Orr, the vice president and the senior 
economist for ABT Associates. 

Welcome to the committee. As you are probably aware, it is our 

Eolicy to swear in all of our witnesses, so as not to prejudice any- 
ody. So if you would rise. 
[Witnesses sworn.] 

Mr. Peterson. I would like to welcome you all to the subcommit- 
tee and I look forward to hearing your testimony. Your full state- 
ments will be made a part of the record. Feel free to summarize 
your remarks and hit the points that you think are the things that 
are the most important. 

We would like to try to keep this to 10 minutes apiece. The mem- 
bers have other committees and there are a lot of things going on 
this morning, so we are going to try to move this along. Again, wel- 
come. Glad to have you with us. 

STATEMENT OF CHARLES C. MASTEN, ACTING INSPECTOR 
GENERAL, DEPARTMENT OP LABOR, ACCOMPANIED BY GER- 
ALD W. PETERSON, ASSISTANT INSPECTOR GENERAL FOR 
AUDIT 

Mr. Masten. Mr. Chairman and members of the subcommittee, 
thank vou for inviting me to testify before you today in my capacity 
as actmg inspector general of the U.S. Department of Labor. As 
stated earlier, I am accompanied by Gerald W. Peterson, who is the 
assistant inspector general for our office of audit. 
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At your request, I am submitting the complete text of my state- 
ment fcr the record and will keep my oral presentation short to 
allow ample time for questions. 

I have been asked to talk about the results of a recent nation- 
wide audit of the Job Training Partnership Act — JTPA — ^program 
outcomes. The audit specifically covered title II-A, disadvantaged 
adult and youth training programs, for program year 1990. 

By way of background. Congress appropriated approximately 
$1.8 billion in 1990 for the title II-A program. The funding was 
used to serve 835,000 individuals, or about 2 percent of the esti- 
mated 36 million eligible population. 

The purpose of JTPA is to "afford job training^ to individuals 
"facing serious barriers to employment. Thus, our audit focused on 
employment barriers. We set out to determine whether the pro- 
gram operators were identifying and addressing employment bar- 
riers of individuals enrolled in the program, what types of training 
and supportive services were provided, what the costs were, and 
what happened to the participants when they left the program. 

For our audit purposes, we organized employment barriers into 
three categories: Job barriers, educational barriers, and personal 
barriers. 

Job barriers primarily consisted of a lack of job skills, job search 
skills, and labor market information. Educational barriers pri- 
marily consisted of school dropouts and deficiencies in reading and 
mathematics. Personal barriers included lack of child care, lack of 
transportation, and disabilities. 

Employment barriers were identified for 93 percent of the par- 
ticipants. The employment barriers that were most frequently iden- 
tified and addressed concerned individuals' needs for occupational 
training, job search assistance, and labor market information. 

Program operators also identified and addressed individual needs 
for supportive services, such as transportation and child care. 
These job related and personal circumstance barriers were the 
types of barrievs Federal job training programs have historically 
done well at identifying and addressing. 

Program operators also identified numerous educational and per- 
sonal barriers, such as school dropouts, reading and math aefi- 
ciencies, health problems, disabilities, and substance abuse. About 
72 percent of the participants were found to have at least one of 
these barriers. 

However, these barriers were addressed at a much lower rate 
than the barriers related to job skills. For example, 45 percent of 
adult participants read below the seventh grade level but only 27 
percent of those received help from JTPA with reading. 

Determining the total investment for each pp.rticipant was im- 
possible. Financial records were usually not maintained on a par- 
ticipant basis. When we were able to identify training and support- 
ive service expenditures by participant, the average investment 
was about $1,506 per participant. 

Of the participants who left the program, we estimated that 53 
percent obtained jobs; 14 percent achieved "employability enhance- 
ments" — that is, completed training which provided the potential 
for employment; 33 percent did not obtain jobs or achieve an em- 
ployability enhancement. 
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Of the participants who got jobs, 49 percent earned wages of $5 
or less; 49 percent of the participants interviewed by auditors said 
they found their iobs without JTPA assistance. 

We interviewed approximately 54 percent of the participants who 
obtained jobs. At the time of the interview, 49 percent were still 
working tor their original employer; 26 percent were working for 
another employer; 5 percent were in school or the Armed Forces; 
and 20 percent were unemployed. 

The Con^fress recognized that job training is an investment in 
human capital and not an expense. The act states that: "The basic 
return on investment is to be measured by increased employment 
and earnings of participants, and reductions in welfare depend- 
ency." However, analysis of the audit data raises, we believe, some 
serious questions about the expectations placed on the JTPA title 
II~A program. 

With respect to the 1992 JTPA amendments, the Office of Inspec- 
tor General supported the stronger accountabilitv provisions in 
these amendments. We believe the amendments will make the pro- 
gram more fiscally responsible. 

However, the amendments will not solve the dilemma faced bv 
the job training system in carrying out its legislative mandate witn 
the current level of funding. The job training system is being asked 
to address education failures, physical dependencies, and emotional 
and physical disabilities with little fundfing and no demonstrated 
pattern that JTPA can successfully treat these barriers. 

Mr. Chairman, this completes my oral presentation. Thank you 
for giving me the opportunity to make this statement Mr. Peterson 
and I will be awaiting your questions. 

[The prepared statement of Mr. Masten follows:] 
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STATEMENT OF 
CHARLES €• MASTEN 
ACTING INSPECTOR GENERAL 
U.S. DEPARTMENT OF LABOR 
BEFORE THE 

SUBCOMMITTEE ON EMPLOYMENT, HOUSING AND AVIATION 
COMMITTEE ON GOVERNMENT OPERATIONS 
U.S. HOUSE OF REPRESENTATIVES 
APRIL 29, 1993 



Mr. Chairman and Members of the Subcommittee: 

Thank you for inviting me to testify before you today in my capacity as 
Acting Inspector General of the U.S. Department of Labor. I am accompanied 
this morning by Gerald W. Peterson, Assistant Inspector General for Audit. 
My comments this morning do not necessarily represent the viewpoints of the 
Department of Labor. 

I have been asked to talk about the results of a recent nationwide audit of 
Job Training Partnership Act CITPA) Program Outcomes. The audit 
specifically covered Title II-A, disadvantaged adult and youth training 
programs, for program year 1990. 

By way of background, Congress appropriated approximately $1.8 billion 
in 1990 for the Title II-A program, the largest of the JTPA programs. It has 
been estimated that over 36 million people were eligible to be served by the 
program in 1990. 

Consequently, JTPA must limit its coverage and provide services to 
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a very small percentage of the eligible population. Thus, the program served 
about 2.3 percent of the eligible population in 1990, that is, about 835,000 
individuals participated at any given time during the year and about 581,000 
exited from the program. 

The purpose of JTPA is to "afford job training" to individuals "facing 
serious barriers to employment/ Thus, our "outcomes" audit focused on 
employment barriers. The audit was conducted at 35 randomly selected local 
sites called service delivery areas where a total of 1,750 reported terminations 
were selected for review. The audit results were projected to the national 
universe and represent estimates of program activities nationwide. 

Our audit objectives were to determine whether program operators were 
identifying and addressing employment barriers of individuals enrolled in the 
program; what types of training and supportive services were provided; what 
were the costs; and what happened to the participants when they left the 
program. 

For our audit purposes, we organized employment barriers into three 
categories: job barriers, educational barriers, and personal barriers. Job 
barriers primarily consisted of a iack of job skills, job search skills, and labor 
market information. Educational barriers primarily consisted of school dropouts 
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ai J deficiencies in reading and mathematics. Personal barriers included a lack 
of child care, transportation and disabilities. 

We learned that not all the program terminations were correctly reported. 
Of the 581,000 terminated participants reported by ETA for Program Year 
1990, we projected that at least 18 percent or 104,777 terminations were 
improperly reported. 

We found that program operators identified employment barriers 
primarily for Department of Labor reporting purposes. Further, there were no 
standard definitions nor guides for ranking the seriousness of the barriers. 
Participants were often evaluated and then received training offered by the 
program operator, regardless of whether the training addressed the individual's 
specific needs. 

Employment barriers were identified for 93 percent of the participants. 
Sevent>'-two (72) percent of the participants met the criteria for "hard-to-serve" 
clients as defined in the September 1992 amendments to JTPA. Since the 
amendments require that at least 65 percent of participants be "hard-to-scrvc" 
clients, the program was already enrolling the types of persons targeted by the 
amendments. 

The employment barriers that were most frequently identified and 
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addressed concerned individuals* needs for occupational training, job seurch 
assistance, and labor market information. Program operators also identified and 
addressed individuals* needs for supportive services, such as transportation and 
child care. Federal job training programs have historically done well at 
identifying and addressing tliese types of job-related and personal circumstance 
impediments to employment. 

Program operators also identified numerous educational and personal 
barriers, such as school dropouts, reading and math deficiencies, health 
problems, disabilities, and substance abuse. About 72 percent of the 
participants were found to have at least one of these barriers. However, these 
barriers were addressed- at a much lower rate than the barriers related to job 
skills. For example, 45 percent of adult participants read below the 7th grade 
level, but only 27 percent of those received help from JTPA with reading. 

Determining the total investment for each participant was impossible. 
Financial records were usually not maintained on a participant basis. Indirect 
costs of state, SDA, and program operator administration were not calculated 
on a participant basis. Likewise, the indirect cost for in-house training or 
support services staff were not accumulated or allocated on a per participant 
basis. 
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We could identify direct payments made lor training and assistance in 78 
percent of our sampled participants, and the average investment was about 
$1,506 per participant. Sixty percent (60%) of payments averaged below 
$1,500; 46 percent of payments averaged below $1,000. 

Of the participants who left the program, we estimated that: 

• 53 percent obtained jobs. 

• 14 percent achieved "employability enhancements," that is, 
completed training which provided the potential for employment. 

• 33 percent did not obtain a job nor achieve an employability 
enhancement. 

Of the participants who got jobs: 

• 49 percent earned wages of $5.00 or less. 

• 49 percent of the participants interviewed by auditors said they 
found their jobs without JTPA assistance. 

We interviewed approximately 54 percent of the participants who 
obtained jobs. At the time of the interview: 

• 49 percent were still working for their original employer. 

• 26 percent were working for another employer. 

• 5 percent were in school or the Armed Forces. 
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• 20 percent were unemployed. 

The Congress recognized that job training is an investment in human 
capital and not an expense. The Act states that "the basic return on investment 
is to be measured by increased employment and earnings of participants, and 
reductions in welfare dependency." Aaalysis of the audit data raises, we 
believe, some serious questions about the expectations of the JTPA Title II-A 
program. 

We believe the following questions need to be answered in order to 
clarify the expectations of JTPA: 

• Is the current network of state and local operations the most 
efficient and effective way to deliver JTPA services? 

• Should JTPA expend its resources to provide labor exchange 
services such as job search, labor market information, and job 
referral services? If so, what is the role of the U.S. Employment 
Service with a Fiscal Year 1993 budget of approximately $900 
million? 

• Should recruitment and placement functions be independent of 
training to prevent the program operators from inflating 
performance figures by servicing only job-ready clients? 

6 
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• Should JTPA interventions only address job training barriers letting 
other government resources address educational and personal 
barriers? 

• Should JTPA enroll individuals only after educational and personal 
barriers have been eliminated by the other programs? 

• Should JTPA expenditures be considered ''an investment in human 
capital" given the program's limited opportunity to create value, 
i.e., increase employment and earnings and reduce welfare 
dependency? 

• Should the success of the JTPA program be measured differently? 

• Should JTPA attempt to be all things to all individuals or should it 
assume a narrower role? 

Mr. Chairman, this completes my response to the first question in your 
April 13 letter. I would like to respond now to the remaining questions: 

1992 Amendments . Overall, the Office of Inspector General supported 
the stronger accountability provisions in the 1992 JTPA amendments. We 
believe these amendments will make the program more fiscally responsible. 
However, the amendments will not solve the dilemma faced by the job training 
system in carrying out its legislative mandate with the current level of funding. 

7 



17 



14 

The job training system is being asked to address education failures, physical 
dependencies, and emotional and physical disabilities with insufficient funding 
and no demonstrated pattern that JTPA can successfully treat these barriers. 

Performance Measures. You asked me to address whether placement 
rates were an appropriate measurement of program success and to give 
recommendations for revisions or clarifications. In Program Year 1990, the 
Title II-A adult programs were measured in terms of an individual's 
employment rate and weekly earnings 13 weeks after terminating from the 
program. The success of youth programs was measured in terms of the number 
of youth who entered employment following termination and the rate of youth 
who achieved employability enhancements, that is, completed training which 
provided the potential for employment. These "followup" measures for adults 
were established in 1988 and were, in part, a result of our nationwide audit of 
Title HA during 1986-87. 

In an audit report, issued in January 1988, we found that the program 
was successfully achieving a 70 percent placement rate. On the other hand, the 
program was not focusing on hard-to-scrve individuals. Further, the rates of 
reUining participants in jobs, increasing their earnings, and reducing welfare 
dependency were not encouraging. We concluded that the 70 percent placement 
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rate achieved by the program had been caused by the performance measures, 
which, at that time, emphasized placement rates. In order to improve retention, 
increase earnings, and reduce welfare dependency, we rcconmaended that ETA 
develop measures and standards which would focus the system on providing 
training which influenced longer-term, more stable employment. 

In establishing the "followup" measures, ETA moved tov/ard emphasizing 
longer-term successes, and we supported these changes. However, as our 
report pointed out, many of the problems widi JTPA today have to do with 
unreasonable expectations for the amount of funding. Although we would like 
to see the program measured in terms of employment barriers addressed and 
overcome, we believe that measures should not be changed until the 
expectations of the program are clarified. 

Administrative and Financial Accoun tability System s. The 1982 JTPA 
statute limited administrative spending to 15 percent. The 1992 amendments 
raised the limit to 20 percent. In March 1992, we issued an audit report that 
compared the costs reported by two service delivery areas to costs allocated by 
auditors. In one case, the auditor-allocated administrative costs were actually 
20 percent higher than reported. In the second case, the administrative costs 
were 12 percent higher. 
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These costs were not inaccurately reported, however, because of 
regulations issued by the Employment and Training Adnunistration in 1983 
Thcso regulations provided for "single unit charging" when performance-based, 
fixed-unit-price contracts were used. In other words, when these contracts 
were used, all costs could be charged to training regardless of whether they 
were for administration, participant support, or training. This regulatory 
provision, which we believe had no basis in law, effectively allowed some 
entities in the JTPA system to get around the 15 percent administrative 
limitation. 

OIG strongly supported eliminating this practice, and the 1992 
amendments restrict vhe "single unit charging" of all costs to certain tuition 
payments only. We will not know imtil the amendments are implemented 
beginning in July 1993 whether these changes will effectively control single unit 
charging and ensure better compliance with the 20 percent administrative cost 
limitation. 

In terms of accurate cost-effectiveness evaluations, the lack of uniform 
cost principles and adequate performance and outcomes data on the system 
precluded meaningful cost-effectiveness evaluations in the past. However, the 
1992 amendments require uniform cost principles, including adherence to 
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generally accepted accounting principles, and collection of more data on 
participants. The Employment and Training Administration is in the process of 
implementing a major expansion in the amount of data collected on JTPA 
participants. The Standardized Program Information Reporting (SPIR) system 
requires states to maintain socio-economic, program participation, and outcome 
information on each participant in JTPA Titles IIA, IIC, and in. 
Unfortunately, the outcome information does not include information on an 
individual* s welfare dependency after JTPA. However, the SPIR system, 
coupled with more consistent cost data, will greatly enhance the ability to 
determine whether JTPA is cost effective. 

Remedial Education Requirements . The April 13 letter contained a 
question about the Department's implementation of the 1986 remedial education 
requirements under JTPA. These requirements, which were included in 1986 
amendments to JTPA, were included under Title IIB, the Summer Youth 
Employment and Training Program. This program differs from Title IIA, 
which was the subject of our JTPA Program Outcomes audit, which I have 
discussed in this testimony. According to the Act, the purposes of the summer 
youth program are to: 

• enhance the basic educational slcills of eligible youth, 
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• encourage school completion, or enrollment in supplementary or 
alternative school programs, and 

• provide eligible youth with exposure to tlie world of work. 
The Inspector General's Office recently issued an audit report on the 

1992 Summer Youth Employment and Training Program. The 1992 program 
received approximately $L2 billion in funding consisting of $700 million in 
regular funding and $500 million in supplementary funding. 
The Inspector General's Office reviewed 21 service delivery areas, visited over 
840 worksites, and interviewed key staff and over 1,200 participants to 
determine whether the work experience and remedial education programs were 
successful « 

We found that the work experience program was a success. Youth 
participants were productive, interested, and closely supervised. However, the 
remedial education program was a limited success. There 
were several problems: 

• Although participants were tested at all the SDAs, coordination 
with the local schools did not always occur. 

♦ At six SDAs, participants were not assessed to determine if they 
needed remedial training, as required by the Act. 
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• While reading and mathematicr training was provided at all the 
SDAs, the term "remediation" also included courses in such 
subjects as history, government, economics, algebra, and science. 

• Most of the 21 SDAs did not serve those most in need, but rather 
used such practices as giving the participant the option to attend 
remediation or providing remediation to participants only in certain 
locations or age groups. 

Thank you for giving me the opportunity to make this statement. We 
will be happy to take yoor questions at this time. 



13 




20 




BESTCfflf/IVAttflDlE 



21 



U.S. DcpartiTMftl ot Ubor 



Mi t INN 



one* Of ifttfMckK Gtncf ai 
W»arw^ OC 202to 




MEMORANDUM FOR: CAROLYN M, OOLDING 
Acting AssisUDt Secretary for 
. Employment and Training 

FROM: /(^EFMX) W, PETERSON 

/ Assistant Inspector General 
for Audit 



SUBJECT: 



Job Training Partnership Act (JTPA) 
Program Outcomes 
Report No. 09-93-201-03-340 



Attached is a copy of our final report on participant outcomes resulting from the Job 
Training Partnership Acl Program. We conducted the audit in accordance with the 
Government Auditing Standards (1988 revision), as esUblished by the Comptroller 
General of the United States. 

Our audit raiics questioos about the expectations of the JTPA program. It would be 
possible to conclude the program, in its current form, may never ^chieve the goah set 
forth in law in terms of increasing employment and earnings of participants and reducing 
welfare dependency. This dilemma has prompted us to pose a series of questioas which 
we believe should be answered as the program tries to implement the mandates of the 
September 1992 ameadneAft. 

We have inchided your written comments to our draft report as Appendix D. As a 
result ci your comments we have inchided an expanded discussion of the sampling 
methodology (Appendix A). Also, where appropriate, wt have adjusted specific report 
wording based on your comments. 

If you have any questions, please contact me at 219-8404. \ 
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Important Information 



Data in this report reflects a national 
picture of the JTPA program. Our 
sample was not selected to be 
representative of individual program 
operators, service delivery areas, or 
states. 

All data in this report is based on 
projected totals of properly reported 
terminations. Our projections are 
subject to a 3 percent sampling error 
at the 95 percent confidence level. 
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EXECUTIVE SUMMARY 



This report presenU the results of our Office of Inspector General 
(OIG) nationwide audit of Profram Year 1990 Job Training 
Partnership Act (JTPA) prof rama funded under Titk II-A of the 
Act We conducted the review to find out if prof ram operators 
identified and eliminated partidpants* employment barriers and to 
determine what happened to the partidpanU when they left the 
profram. 

Conjrett appropriated $1.8 billion to fund the Program Year 1990 
Title U<A program. While that appears to be a subsUntial 
investment it is, in fact relatively insignificant. For that same time 
period, the Employment and Training Administration (ETA) 
ettimated that over 36 million people were eligible to be served by 
the Title II-A program. Per capita, only $50 was available for each 
eligible person. 

Further, the kgtslatios requires tkat a network of sute awl local 
operatofs deliver the prograM. Tket«forc tke $50 was further 
dilated tfy the administrative' com associated with 59 state trast 
territoiy officer and 636 teivicc dcUveiy area (SDA) offices. * ETA 
has catimted that cfver 18,000 pmoos arc enployed by tbt atue 
asdSDA olfloaa. Further, there h a private industry couadi for 
eachof the636SDAoffiMs. Ahkough the 9,000 or so members of 
these councils serve voluntarily, travel, meab, and other 
adaniatstrativc costs are paid 1^ JTPA. Hnally, thousands of 
contractors participate in providiag training and services. TW 
number of ooatractor pertoMel is aakaowia, b«t ETA est»atea 
start at 20y000. 

C«ue<pae«tly» HPA mast limit ita coverage and provide services to 
avetysaianperceatafeofthec%i>)epop«kti(Ni. ForProfran 
Year 1990 the prograM repotted aciviag ^bo«t «l5/MNLMivid«ak 
or ahowt 2J percent of Ifee el%Me popalatkm. During that year 
abotttr^iUnO persoos were reported as terminating from the 
program. ' 
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EXECUnVI SUMMAEY 



We found program operaton kkatified aod provided tnininf and 
assisUDCC to cUminate many types of cmploymcDt barriers. The 
barriers moct often identified and addressed involved the need for 
job skilb or help in searching for a job. In most cases, program 
operators identified and prodded interv^ntioas to help individuals 
who needed occupational training* job search assistance, and labor 
market information. The program operaton also identiBed and 
addressed individuals* needs for supportive services, such as 
transportation and child care. These are the types of employment 
barriers Department of Labor training programs have historically 
done well at addressing. 

Conversely, program operators also identified numerous educational 
and personal barriers, e.g., school dropouts, reading and math 
deficiencies, health problems, disabilities, and subsunce abuse. 
About 72 percent of the participants were found to have at least 
one of these baniers. However, the program operators addressed 
these barriers at a significantly lower rate than job skills barriers. 
For example. 45 percent of the adult participants read below the 7th 
grade level, but only 27 percent of those received help from JTPA 
with their reading deficiencies. 

Determining the total investment for each participant is impossible. 
Financial records are not usually maintained on a participant basis. 
Where we were able to identify training and assisunce expenditures 
for participants, tiie average investment was about $1,300. This is 
not surprising considering the $1.8 billion appropriation spread 
among the 835,000 participants averages about $2,150. 

Our audit found the 1990 program produced the following: 

• 53 percent of participants obtained jobs. 

• 14 percen; achieved *employability enhancements," 
i.e., completed training which provided the potential 
for employment 

• , 33 percent did not obtain a job or attain an 

employabillty enhancement 
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EXECUTIVE SUMMARY 



However, of the participants who got jobs: 

• 49 percent earned wages of $5.00 or less. 

• 49 percent of the participants interviewed by OIG staff 
said they found their jobs without JTPA assistance. 

We interviewed approximately 64 percent of the participants who 
obtained jobs. At the time of the interview: 

• 49 percent were still working for their original 
employer. 

• 26 percent were working for another employer, 

• 5 percent were in school or the Armed Forces, 

• 20 percent were unemployed. 



f\ We also conucted the emptoyeis who hired JTPA partkipaats. 
I Siitv-fivt peiceBt oC the emplovci^ we oxitacted that hired 
/ {)artk1pant» after reGcivtng an o»>the-j6b inli&'g'ttbtidx «*«ted they 
Lyould have Wrcd the person witfcout the ITPA'tubndy. 



"^J^^^^TJJJT^^ Given the information our audit developed* one might conclude the 
Prosr*^. in '^^ current form, camot achkVe'thiriQP^K^iotlk im 
.^' yi. •^^f'vV'^ ^ ^ increasing participaflt employinairin'd earaiiga and 
reducing welfare dependency. AaaljpriioCtkeavditdataraim, we 
believe, tome terkmt <{uestk»» i*o«t tiM ttpttMmoimt JlPA 
pfog;ra«. llMj(*tmiaiitg listen kbel^g^tM.lttad^ 
edocatiott liAirc^ pfcyriod depokkacki $md mki^ti $wi 
phytr:al dinbOHiet witk Vole fctsdSagtU mo6mmmtM pttteni 
that i iTA oOiMpoeMfiitty tteat f^tn tMrtm 

Thb dilemma poses several quetfiona regaiding the directioo the 
program aeedft lo take. Therefore, ratb<3r thaa maldag 
recommendatioM. we are raisia^ what we believe are pertinent 
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EXECUTIVE SUMMARY 



questions which should be answered is the program tries to 
implement the mandites of the September 1992 imendments. 

Is the cunent network of state and local operators the most 
efficient and effective way to deliver JTPA scrvicks? 

Should JTPA expend its resources to provide labor exchange 
services such as job search, labor market information, and job 
referral services? If so» what is the role of the U.S. 
Employment Service with a budget of $850 million? 

Should recruitment and placement functions be independent 
of training to prevent the program operators from inflating 
performance figures by serving only job-ready clients? 

Should JTPA interventions only address job training barriers, 
letting other government resources address educational and 
personal barriers? 

Should JTPA enroll individuals only after educational and 
personal barriers have been eliminated by the other 
programs? 

Should the JTPA expenditures be considered "an investment 
in human capital" given the program's limited opportunity to 
create value, i.e., increase employment and earnings and 
reduce welfare dependency? 

Should the success of the JTPA program be measured 
differently? 

Should JTPA attempt to be all things to all individuals or 
should it assume a narrower role? 



This report contains three sections. Section I contains signifKant 
findings from the data gathered. Section II contains statistical 
tables. Section III, separately bound, contains a history of the JTPA 
experiences of the participants studied during the review. 



4 




29 



Mr. Peterson. Thank you, Mr. Masten. We appreciate your 
being with us. Mr. Crawford. 

STATEMENT OF CXARENCE C. CRAWFORD, ASSOCIATE DIREC- 
TOR, EMPLOYMENT AND EDUCATION ISSUES, HUMAN RE- 
SOURCES DIVISION, GENERAL ACCOUNTING OFFICE, AC- 
COMPANIED BY THOMAS MEDVETZ, AND SIGURD NILSEN 

Mr. Crawford. Mr. Chairman and members of the subcommit- 
tee, we, too, are pleased to be here today to discuss with you the 
effectiveness of title II-A of the Job Training Partnership Act in 
meeting the employment and training needs of the economically 
disadvantaged. 

I would like to introduce, on my immediate right, Mr. Sigurd 
Nilsen and on my far right, Mr. Thomas Medvetz, who are respon- 
sible for much of our work in this area. 

Although JTPA is the Nation's chief federally funded employ- 
ment ana training program, it is but one of many programs oflen 
operating in isolation and creating a difficult maze for service pro- 
viders and those who are in need of assistance. We have identified 
125 Federal employment and training programs, including JTPA, 
that are administered by 14 departments and independent agen- 
cies, spending about $16 billion annually. 

In summarizing my statement, I will be focusing on the effective- 
ness of JTPA, the likely impact of recent changes to JTPA, and im- 
provements needed in the overall Federal response to employment 
and training needs of the economically disadvantaged. My testi- 
mony will be based on our prior and ongoing work as well as a re- 
cent national study of JTPA prepared for the Department of Labor. 

JTPA is viewed as a relatively successful program because it has, 
for the most part, met or exceeded its performance standards with 
an overall 60 percent placement rate for those who complete or 
leave the program. Perrormance standards measure how well local 
programs, SDA's, are placing people in jobs and at what wage, but 
they don't provide an assessment of JTPA's overall impact on the 
people it is serving. 

Tne Labor Department contracted with MDRC and ABT Associ- 
ates to undertake an impact evaluation of how JTPA normally op- 
erates. The interim results suggest that JTPA may not be effective 
for youth and may be only marginally effective for adults. We are 
not completely surprised by the ABT findings, given the results of 
our prior work and the fact that the average JTPA participant re- 
mains in the program 18 weeks. 

From our prior work, we noted that SDA*s appeared to be follow- 
ing a low-risk approach to serving the economically disadvantaged. 
Those who were least ready to enter the job market were provided 
the least-intensive services. That is, they were less likely to receive 
occupational training than other groups. When they did receive 
such training, they received fewer training hours and were less 
likely to be trained in higher-skilled jobs. 

We concluded that those who received training in higher occupa- 
tional skills, regardless of how job ready they were, tended to get 
better jobs than those who received other training services. We also 
noted that performance-based incentive services can encourage em- 
ployers to steer certain participants into low-wage training. 
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A in^or premise for JTPA and other training programs is that 
services provided should make a difference. Since the ABT studv 
did not compare alternative service approaches, we believe that ad- 
ditional impact evaluations are needed to provide policymakers 
with information on how best to serve the aisadvantaged and to 
maximize program resources. 

Mr. Chairman, concerning the recent changes to JTPA, we, too, 
agree that the changes will help to improve JTPA. 

First, the amendments require that at least 65 percent of those 
served be economically disadvantaged and have one or more em- 
ployment barriers, such as being a dropout or on welfare. 

Second, the amendments require SDA's to not only objectively as- 
sess the needs of each participant, but to develop and implement 
an individual service strategy. 

While these provisions should help, we still believe that inde- 
pendent participant assessments are needed to eliminate the poten- 
tial bias that exists when service providers with vested interests 
are responsible for performing these assessments. 

Third, the recent Labor Department initiative to expand JTPA's 
data-collection efforts should further enhance program manage- 
ment Expanded information on participants will allow program 
managers to better determine the program outcomes achieved from 
different training interventions for various groups of individuals. 
Program officials can also use the data to help make regional and 
State-level comparisons and to identify locations that may be in 
need of technical assistance. 

The above modifications are good. However, effective implemen- 
tation is critical. Since the start of JTPA, the Labor Department 
has followed a hands-off approach. Our previous work has shown 
that Labor's passive approach has resulted in program inconsist- 
encies and problems going undetected. 

For example, we found that, in some SDA's, administrative costs 
exceeded limitations by 68 percent, excessive amounts of OJT — on- 
the-job training funds — were approved in 73 percent of the low-skill 
contracts, and that improper or unsupported payments were made 
to service provides in two-thirds of the SDA's sampled. 

Mr. Chairman, concerning the need for a comprehensive Federal 
training strategy, JTPA is the Federal Government's largest em- 
ployment assistance program for the economically disadvantaged, 
but it is not the only one. Federal efforts to upgrade the skills of 
the disadvantaged are carried out through 65 different programs 
that are administered by 13 departments and independent agencies 
and funded at over $11 billion annually. 

These myriad programs do not function as a comprehensive, co- 
hesive system, but often operate in isolation. We are currently con- 
ducting several studies on behalf of the Congress that will look at 
some of these issues. 

In addition, the 1992 amendments to JTPA reflect the need for 
coordination by establishing State resource investment councils 
that are aimed at coordinating services and funds for programs 
such as JTPA, adult education, and the jobs, opportunities, and 
basic skills programs. However, State compliance with these provi- 
sions is voluntary and State councils on vocational education may 
elect not to participate. 
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Several States and local communities, as you had mentioned, 
have undertaken self-initiated efforts to better coordinate and more 
effectively provide services to those who are in need. These entities 
have launched their initiatives despite substantial barriers, such as 
conflicting program requirements, differing target populations, and 
staff resistance. 

By way of example, the State of Massachusetts concluded that its 
35 Federal employment and training related programs were operat- 
ing largely in isolation and, in 1988, the State launched an effort 
to address this problem. 

The administration has proposed, in its fiscal year 1994 budget, 
a strateaj based on the concept of one-stop career centers. While 
the specifics are yet to be identified, this concept could be an im- 
portant step in rationalizing employment and training assistance 
in the United States. 

Mr. Chairman, this concludes my testimony, and I will be happy 
to answer any questions that you or members of the subcommittee 
may have. Thank you. 

[The prepared statement of Mr. Crawford follows:] 
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SUMMARY OF TESTIMONY BY CLARENCE C> CRAWFORD 
JOB TRAINING PARTNERSHIP ACT 
POTENTIAL FOR PROGRAM IMPROVEMENTS BUT NATIONAL JOB 
TRAINING STRATEGY NEEDED 

Title UA of the Job Training Partnership Act (JTPA) provides job training and 
employment seeking skills to economically disadvantaged individuals who need 
training and other labor market services to obtain employment . Although JTPA has 
been viewed as relatively successful in placing participants in jobs, a recent study 
raises questions about whether the program is as effective as it could be. In our 
view, the effective implementation of the 1992 amendments to JTPA, coupled with an 
increased emphasis on program evaluation and a national strategy to eliminate 
confusion and duplication among the myriad training programs, could substantially 
improve the program. 

JTPA PERFOBUANCE AND EFFECTIVENESS. JTPA has consistently placed the 
majority of those receiving services in jobs and, thus, generally has been viewed as 
successful. However, a recent study indicates that the program is only marginally 
increasing the earnings and employment of certain client groups above comparable 
nonparticipating groups, and thus is of limited effectiveness. What is unknown is 
which training services make the greatest difference in Improving the employment 
opportunities for various groups of participants . Evaluations are needed to 
determine which treatments make a difference. 

RECENT CHANGT^ TO JTPA. The 1992 amendments to JTPA, along with a 
Department of Ld jor data collection initiative » have the potential to substantially 
improve the JTPA program by providing apedflc guidance on program targeting, an 
objective assessment and training plan for all participants, and more meaningful and 
comprehensive data on program operations. However, effective implementation of 
these changes Is critical to success. In ao doing, Labor ahotild assume a more active 
role than it has taken In the past and provide detailed guidance to ensure that the 
new requirements are strictly followed and use Its expanded data system to better 
manage the program. Labor also should continue to fund studies aimed at assessing 
JTPA»s impact. 

NEED FOR A NATIONAL TRAINING STRATEGY. JTPA is one of 65 federal programs 
that spent over $11 billion in fiscal year 1991 on employment and training services for 
the economically disadvantaged. These programs do not function as a 
comprehenaive, cohesive system » but ofteu operate in isolation. Because of the 
myriad programs » the effective Implementation of changes to JTPA alone will not 
assure that the training needs of the economically disadvantaged are addressed . 
Needed is an overall employment and training strategy at the federal level and , at 
the state and local level, a streamlined approach to eliminate duplication and 
confusion and ensure efficient and effective delivery of services. In this respect, 
the administration's proposal for "one-stop career centers" may prove to be an 
important step toward rationalizing employment assistance in this country . 
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Mr. Chairman and Members of the Subcommittee: 

We are pleased to be here today to discuss with you the effectiveness of title IIA of 
the Job Training Partnership Act ( JTPA) in meeting the employment and training 
needs of economically disadvantaged adults and youth. Although JTPA la the 
nation's primary federally funded employment and training program, it is but one of 
many programs often operating in isolation and creating a difficult maze for service 
providers and those who need and are seeking assistance. We have identified 125 
federal programs that are administered by 14 departments or independent agencies, 
spending over $16 billion annually providing employment and training services.^ 
Sixty-five of these programs, including JTPA, spend about $11 billion to serve the 
economically disadvantaged. 

My testimony today will focus on title HA of JTPA, a program that spends about $1.8 
billion a year to provide employment and training services to economically 
disadvantaged adults and youths.^ I will also be focusing on the effectiveness of 
JTPA; the likely Impact of recent changes to JTPA on its effectiveness; and 
improvements needed in JTPA, as well as in the overall federal response to the 
employment and training needs of the economically disadvantaged. My testimony la 
based on our previous and ongoing efforts related to title IIA specifically, and 
employment and twdning programs. In general, aa well as a recent national study c^f 
JTPA prepared for the Department of Labor. These efforts Indicate that, although 
JTPA has been relatively successful in terms of the number of participants who are 
initially placed In jobs upon leaving the program, the program may not be 
substantially Improving the earning potentlsd of the economically disadvantaged In 
this country. 



^Letter to the Chairman, Senate Committee on Labor and Human Resources 
(GAO/HRD-92-39R, July 24, 1992). 

^The act also includes title IIB, a summer youth employment and training program, 
and title III, an assistance program for dislocated workers. The 1992 amendments to 
JTPA transferred year-round services for youth under title IIA to a separate youth 
program under a newly created title IIC . 
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However, the recently enacted amendments to JTPA have the potential to 
substantially improve the delivery of employment and training services and program 
outcomes, if they are effectively implemented. These amendments alone, however, 
will not ensure that the job seeking skills and employment opportunities of the most 
needy are enhanced. Major challenges lay ahead for the Congress and the 
administration in addressing the multitude of employment and training programs 
aimed at the economically disadvantaged . Reducing the number of federal 
employment and training programs could help the coordination of local services , but 
it is unlikely that the number of programs wiU be significantly reduced any time 
soon. A comprehensive, overall employment and training strategy that fosters 
coordination among the many federal programs is needed. Such a strategy should 
continually seek more effective methods of providing services to the economically 
disadvantaged by trying alternative approachas and evaluating their impact. 

BACKGROUND 

JTPA title IIA provides job training and employment seeking sklUs to economically 
disadvemtaged individuals who need training and other labor market services to 
obtain employment. It has been funded at about $1.8 billion annually since 
implementation. Although Labor has overall responsibility for the program, JTPA is 
highly decentralized, with most participants receiving job training services through 
programs administered by the 56 states and territories and over 600 local programa 
called service delivery areas (SDAs). 

SDAs provide employment and training services either directly or through 
agreements or contracts with other service providers. JTPA services include 
occupational training and basic education, normally provided In a classroom setting, 
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on-the-job training (OJT), and work experiance. On average, participants are In 
the program about 18 weeks. 

Generally speaking, individuals are eligible for JTPA if they are economically 
disadvantaged— people in this group are defined primarily by household income but 
this group also includes welfare and food stamp recipients and the handicapped. In 
the fall of 1992, the first comprehensive reforms to JTPA were enacted to improve the 
delivery of services to hard-to-serve persons as well as to make other program 
improvements. Before these amendments, the act provided only general guidance on 
how the program was to be targeted. The act stated that services were to be 
provided "to those who can benefi* from, and who are most in need of them, and 
that local programs are to "make efforts to provide equitable services among 
substantial segments of the eligible population." The lack of specific direction led to 
concern among some in the employment and training community about whether JTPA 
was serving the right individuals in the eligible population. The 1992 amendments 
provide additional direction on targeting by requiring that the majority of funds be 
targeted on hard-to-serve individuals; that is, those with specifically listed barriers 
to employment , such ac being a school dropout or on welfare . 

JTPA is a performance-oriented program. The act requires the Secretary of Labor 
to establish national performance standards against which the performance of 
individual SDAs is measured . JTPA provides for rewai^ls to SDAs that exceed these 
standards and for sanctions for those that fail to meet them for 2 years . For the 
most part, the performance standards measure the extent to which SDAs place all 
participants, as well as those on welfare, in jobs and the wages they receive. 



^Work experience is a training activity consisting of short-term or part-time work 
designed to develop good work habits and basic work skills. 

3 
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JTPA PERFORMANCE AND EFFECTIVENESS 

JTPA is viewed as a relatively successful program because the majority of those who 
participate receive a job upon leaving the program. Yet a recent study^ raises 
questions about whether the program is effective; that is, does it make a difference 
in the employment and earnings of those who were assigned to participate . 
Beginning with the first full year of program operations in 1984, JTPA has placed 
over 60 percent of its participants in jobs each year and, with few exceptions, has 
met or exceeded its performance standards program-wide. The performance 
standards measure how well SDAs are placing people in jobs and at what wage, at one 
moment in time.^ While the standards provide some indication of performance and 
short-term program outcome, they do not provide an assessment of the program's 

c 

overall impact on the people it is serving. 

A recently released study of JTPA suggests that title IIA may not be effective for 
youth participants and may be only marginally effective for adults. The Department 
of Labor contracted with MDRC and Abt Associates Inc. to undertake an impact 
evaluation of title IIA of JTPA, as it normally operates. Their Interim results 
provide some measure of the effects of JTPA services on the employment and 



* The National JTPA Study: Title IIA Impacts on Earnings and Employment at 18 
Months, Abt Associates Inc. (Jan. 1993). 

^In the past, this had been at the time an individual left the program but more 
recently this was changed to 13 weeks after leaving the program. 

^Impact refers to what outcomes JTPA participants achieve, in terms of employment 
and wages, as compared with v/hat they would have achieved on their own, without 
the program. Program impact can be measured by comparing the status of two 
identical groupa of people whose only difference is that one group enrolled in JTPA 
and the other did not. The use of an evaluation methodology known as random 
assignment, in which eligible individuals are randomly assigned to receive JTPA 
services or to a control group not receiving such services , is believed to yield the 
most accurate estimate of program impact. 
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earnings outcomes for program participants' when compared with nonpartlcipants. 
The study results indicate a modest gain In earnings for adult women of $539 for an 
18-month period and an employment gain of a little over 2 percent. The earnings 
gain for adult men was not significant , but they had about a 3 percentage point 
employment gain. The study showed that out-of-school male youths (16 to 21 years 
old) enrolled in JTPA earned $854 less than nonenroUees . ^ 

We were not completely surprised by the results from the Abt study, given the 
results from our previous work. We noted that the SDAs appeared to be following a 
low-risk approach to serving the economically disadvantaged^. Those who were less 
ready to enter the job market were provided less intensive services; that is, they 
were less likely to receive occupational training than other gToups. V/hen they did 
receive such training, they received fewer training hours and were less likely to be 
trained in higher skill jobs. Furthermore, they were as apt to receive only job 
search assistance as other groups. Because training costs likely increase with the 
intensity of services , it appears that less JTPA funds were being spent on behalf of 
those less job ready. However, we concluded that those who received tralixing in 
higher skil! occupations, regardless of how ready they were to enter the world of 
work, tended to get better jobs at higher wages than those who received other 
training services. We noted in another study, on racial and gender disparities In 
JTPA services , that performance-based financial incentives can encourage service 
providers to steer certain participants into low-risk training and away from higher 



'Findings reported from the Abt study refer to results for program assignees, that 
is, those for v/hom JTPA services were made available 

'Almost till of the negative impact on earnings is concentrated in youth who reported 
having an arrest record. 

Vob Training Partnership Act: Services and Outcomes for Participants With 
Differing Needs (GAO/HRD-89-52, June 9, 1989) and Job Training Partnership Act; 
Y outh Participant Characteristics, Services, and Ouicomes (GAO/HRD-90-46BR, 



Jan. 24, 1990). 
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risk training activities. For example, some service providers are reluctant to 
train women in non traditional occupations because of higher costs and higher risks 
of not being placed in a job upon completion. 

A major premise of JTPA or any training and education program Is that the services 
provided will make a difference. Overall, JTPA appeared to only marginally improve 
employment and earnings gains for certain segments of those it served. The Abt 
study did not compare results obtained using altevnative service approaches for the 
hard-to-serve population that is targeted by JTPA. Therefore, the analysis cannot 
tell which services work best. Given that billions of dollars are being spent annually 
on the economically disadvantaged , it is important to know definitively which 
treatments make a difference. In our opinion, such information is essential to 
policymakers in making decisions on how to best serve the disadvantaged and to 
maximize program resources. Therefore, additional evaluations of the program's 
impact are necessary . 

RECENT CHANGES TO JTPA 

Key provisions of the recently enacted amendments to JTPA, coupled with a new data 
collection initiative by the Department of Labor, should go a long way toward 
improving JTPA. These modifications will address program shortcomings, namely, 
(1) the lack of specific guidance on whom JTPA should target for services; (2) the 
need for objective assessments of participants* training needs and developing a plan 
to address those needs; and (3) the need for a more meaningful and comprehensive 
database on who is being served, the services they get, and their program outcome. 
We believe that these changes have the potential to improve JTPA . 



^^ Job Training Partnership Act; Racial and Gender Disparities in 
Services(GAO/HRD-91-148, September 20, 1991). 

6 



43 



40 



The amendments, which for the most part become effective July 1, 1993, were the 
first comprehensive modifications to the program since its implementation in 1983. 
The amendments require that at least 65 percent of those served, in addition to being 
economically disadvantaged, have one or more barriers to employment, such as being 
a school dropout or on welfare. Our previous work indicated that JTPA was not 
targeting services to any particular group and those with the greatest need for 
services were oftentimes provided the least amount of trainiir; 'wrvices. The 
amendments also require that an objective assessment of the skill levels and service 
needs of each participant be carried out €uid that an individual service strategy be 
developed that identifies employment goals, achievement objectives, and appropriate 
services. These provisions should help ensure that the program emphasizes services 
to those with more barriers to employment (and presumably a greater need for JTPA) 
and that the services they receive are appropriate for them to succeed in the labor 
market. However, we believe that a need still exists for independent participant 
assessments to eliminate the potential bias that exists when service providers, with 
vested interests in the assessment results, are responsible for performing these 
evaluations . 

A recent Labor initiative to expand its JTPA data collection requirements should 
further enhance program management by enabling Labor to accumulate detailed 
information on the scope of services and the nature of employment that JTPA is 
providing to its participants, particularly the hard-to-serve. Current reporting 
requirements provide no information on the kinds of jobs that various groups of 
participants receive after program participation or the nature of the occupational 
training and supportive services that may have contributed to different outcomes . 
Labor's expanded data system, to be implemented on July 1, 1993, will provide 
program officials with information on who U served (ha terms of their ddmogiTaphlc 
characteristics and barriers to employment) , the kinds of services they receive 
(Including the number of hours of training) , and their outcome at program 
termination (Including their specific occupation. If placed In a job) . This 
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information will allow program managers to determine the program outcome achieved 
from different training interventions for various groups of individuals. Program 
officials can also use the data to make regional, state, and local level comparisons 
and make judgments about SDAs and states where technlccd assistance may be needed 
to Improve program performance. 

While the above modifications are designed to better measure and monitor program 
performance , effective implementation of these changes is criticed to success . Since 
implementing JTPA, Labor has largely followed a "hands off" approach with respect 
to carrying out the program , and has assumed a role of providing overall policy 
guidance, technical assistance, and limited oversight. Our previous work has shown 
that Labor's passive approach has allowed SDAs considerable autonomy and 
discretion in carrying out the programs. While there may be some advantages to 
this approach, it has also resulted in program inconsistencies and problems at the 
state and local level going undetected, especially with respect to oversight and 
monitoring JTPA program operations. For example, we found that limits on 
administrative costs were circumvented, excessive amounts of OJT were approved, 
and Improper or unsupported payments were made to service providers . In our 
view, in order for the recent changes to JTPA to be fully effective. Labor must take 
a more active role in their implementation by providing detailed guidance to ensure 
that the new requirements are strictly followed and by using its expanded data 
system to better manage the program . This , however , should not be viewed as a 
substitute for program evaluation and Labor should continue to fund studies to 
assess JTPA's impact . 



" Job Training Partnership Act: Inadequate Oversight Leaves Program Vulnerable to 
Waste, Abuse « and Misntanagement (GAO/HRD-91-97, July 30, 1991). 
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NO COHPREHENSIVE FEDERAL TRAINING STRATEGY 
FDR ASSISTING THE DISADVANTAGED 

JTPA is the federal government's largest employment assistance program for the 
economically disadvantaged, but it is not the only one. Therefore, the effective 
implementation of changes to JTPA €done will not assure that the training needs of 
the economically disadvantaged are addressed. Federal efforts to upgrade the skills 
of disadvantaged adults and out-of- school youth to help them got the necessary 
skills to enter the mainstream work force are carried out through 65 different 
programs . These programs are administered by 13 federal departments and 
independent agencies, with funding of $11 .5 billion in fiscal year 1991 . These 
myriad programs do not function as a comprehensive, cohesive system, but often 
operate in isolation . Absent at the federal level is an overall employment and 
training strategy that coordinates and integrates existing programs. Needed at the 
state and local level is a streamlined approach that will (1) eliminate the duplication 
of services and the confusion 8unong the disadvantaged caused by the current 
nonsystem and (2) ensure efficient and effective delivery of services. 

We have ongoing work that is looking into several aspects of the multiple employment 
programs issue. For example, we will be determining the extent to which programs 
have the information and means to judge their effectiveness and whether impact 
evaluations have been performed. Also, we are looking at possible barriers to 
coordination of services and the extent to which employment assistance programs ~ 
which may be adjuncts to other programs without an employment assistance 
objective—are duplicating services of other major programs , 

The 1992 amendments to JTPA recognize the need for coordination by establishing 
state human resource investment councils . These councils are aimed at coordinating 
the provision of services and the use of funds for human resource programs such as 
JTPA, adult education programs, and the Job Opportunities and Basic Skills 

9 . « 



46 



43 



program. However, state compliance with this provision is voluntary, and the state 
councils on vocational education may elect not to participate in such councils . 

Several states and local communities have undertaken self- initiated efforts in an 
attempt to better coordinate and more effectively provide employment assistance 
using the multiple programs available within their boundaries. These entities have 
launched their initiatives despite substantial barriers to change, such as conflicting 
program requirements, differing target populations, and staff resistance. In 
general, the approaches are designed to (1) improve access to services, (2) reduce 
client confusion, (3) improve inde^^endent assessments, (4) reduce duplication of 
services, and (5) improve the ability to track clients. 

While we have not examined these efforts in detail, they appear promising. By way 
of example, the State of Massachusetts concluded that the 35 job training, placement 
and employment-related education programs operating In the state were running 
largely In Isolation. In 1988, the state legislature enacted a law that established a 
two-tier approach to service simplification. At the state level. It established a 
council responsible for (1) planning the use of program resources in an integrated, 
cohesive manner; (2) determining the effectiveness of each program as well as the 
system as a whole; and (3) making the system more responsive to the needs of 
business and program trainees. At the local level, 16 regional boards, made up of 
representatives from the education and employment community, were established to 
oversee the system*s Implementation. The boards operate as a focal point for 
determining which programs should operate within their region and how the 
programs should be carried out. 

We believe that there Is a need, especially In today's climate of fiscal constraint, for 
a simplified system that complements and supplements the common goal of assisting 
the economically disadvantaged, limits the confusion for those seeking services, and 
eliminates wasteful federal spending for duplicative services . Developing a 
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coordinated and simplified approach will require a look at how federal programs could 
work together as a system to more effectively provide employment training assistance 
to the disadvantaged . 

The administration has proposed , in its fiscal year 1994 budget , a strategy based on 
the concept of "one-stop career centers" . While information on the proposal's 
specifics is not yet available , this could be an important step toward rationalizing 
employment assistance in the United States. The career centers would serve people 
in need of career counseling; assessment; occupational information; job referral; and 
training, employment, and related community services. They would offer easier 
access to the confusing array of federal programs and services for adults seeking to 
change jobs or careers or to upgrade their skills . We hope this will turn out to be an 
initiative that can substantially improve program coordination and effectiveness . 



Mr. Chairman, this concludes my testimony. I will be happy to answer any questions 
that you or members of the Subcommittee might have. 



(205250) 
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Mr. Peterson. Thank you, Mr. Crawford. Mr. Orr. 

STATEMENT OF LARRY L, ORR, PROJECT DIRECTOR, 
NATIONAL JTPA STUDY, ABT ASSOCIATES, INC. 

Mr. Orr. Mr. Chairman, members of the committee, I am Larry 
Orr from ABT Associates, a private research firm specializing in 
policy research and program evaluation. I am very pleased to be 
here to have the opportunity to speak to the committee about our 
analysis of the elRFects of JTPA in 16 local service delivery areas 
across the country. 

The national JrTPA study provides the first reliable evidence of 
the impact of JTPA on the educational attainment, emplojonent, 
and earnings of disadvantaged youths and adults. By "impact," I 
mean the ^ins or losses in those outcomes that resulted from par- 
ticipation m the program — what might be termed the program's 
"value added." 

We measured the impacts of the program with a method that is 
very similar to that used in clinical trials of new drugs. In each 
SDA, applicants to the program were randomly assigned either to 
go into the program or to go into a control group that was excluded 
from the program. 

Random assignment assures that the control group does not dif- 
fer from the program participants in any systematic wav except 
that they were not allowed access to the program. Therefore, any 
subsequent differences in outcomes between the program partici- 
pants and the control group can be confidently attributed to the 
program. 

Suppose, for example, that average earnings in the control group 
were $10,000 and average earnings of tne participarls were 
$11,000. Our measure of impact would be a $1,000 earnii^gs gain. 

Random assignment is widely viewed as the only reliable way to 
measure the impact of employment and training programs. For this 
reason, when the Department of Labor set out to evaluate JTPA in 
1986, they specified random assignment as the method of choice. 
More recently, in the 1992 JTPA amendments, the Congress speci- 
fied that the methods to be used to evaluate the program should 
include random assignment. 

It is important to note that, while the control group was excluded 
from JTPA, they were allowed to receive any other education, em- 
ployment, or training services to which they were otherwise enti- 
tled. Thus, the benchmark against which we measure the impacts 
of JTPA is the other services available in the community, not the 
total absence of services. This means that our impact estimates 
measure the incremental impact of JTPA over and above the effects 
of other services the participants would have received in the ab- 
sence of the program. 

This study is oased on a sample of over 20,000 adults and out- 
of-school youths who applied to JTPA title II-A in the 16 study 
sites over a 22-month period from 1987 to 1989. The results cur- 
rently available follow the sample for 18 months after, random as- 
signment. 

We performed separate analyses for adult men, adult women, 
male out-of-school youths, and female out-of-school youths. We did 
not study in-school youths. Within each of these groups, we exam- 
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ined the experience of three different "service strategy^ subgroups: 
Those recommended for classroom training in occupational skills: 
those recommended for on-the-job training; and those recommended 
for less intensive services, such as job search assistance, basic edu- 
cation, and job-readiness training. 
For adults, the major findings were: 

First, for both adult men and adult women, JTPA approximately 
doubled the rate of attainment of a high school credential— that is, 
either a high school diploma or a GED— during the followup penod; 
second, the on-the-job training service strategy significantly raised 
the earnings of both men and women. We estimate that the pro- 
gram increased the earnings of adult JTPA enrollees in this sub- 
group by about $900 per year; third, the classroom training service 
strategy significantly increased the earnings of adult women in the 
post-program period but had no statistically significant effect on 
the earnings of adult men. The adult women in this subgroup who 
enrolled in JTPA experienced annualized earnings gains of about 
$900 in the last 6 months of the followup period. , , ^ , 

Finally, neither the women nor the men recommended for less in- 
tensive services experienced any statistically significant earnings 
gains during the followup period. 

For out-ofschool youths, the principal results were: 
First, the program increased the proportion of male youths who 
attained a high school credential from 14 percent of all dropouts to 
24 percent. Similarly, it raised the percentage of female youths re- 
ceiving a high school credential from 17 percent of all female drop- 
outs to 29 percent; however, the program had no statistically sig- 
nificant positive effects on the earnings of any of the youth 
siigroups; in fact, enrollment in JTPA actually reduced the earn- 
ings of male youths recommended for on-the-job training and less 
intensive services by amounts on the order of $1,200 to $1,500 per 
year. Further analysis revealed that these earning losses were al- 
most entirely concentrated among male youths who reported that 
they had been arrested prior to entry into the program. This sub- 
group constituted 25 percent of the male youths and only about 2 
percent of Uie overall sample. _ 

Overall, then, the program appears to have had positive etrects 
on the educational attainment of all demoCTaphic suberoups* mod- 
est positive effects on the earnings of adults, especially in the on- 
the-job training subgroup; and no effect on the earnings of youths, 
except for male youths who had been arrested prior to entry into 
the program, whose earnings were actually reduced as a result of 
participating in the program. 

In viewing these results, it is important to bear several things 
in mind: First, the 16 study sites are not necessarily representative 
of the Nation, although they do reflect the diversity of programs 
found across the country; second, the program experience on which 
the study is based occurred in 1987 to 1989, and a number of 
changes nave taken place in the program since that time, most no- 
tably the 1992 amendments; third, our results are restricted to the 
JTPA titles serving disadvantaged workers and our sample did not 
include in-school youths; and fourth, these findings cover only the 
first 18 months after program entry. Some of these results could 
change with longer followup. 
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Finally, it will be important to consider these program impacts 
in relation to the costs of the program. In our final report to be re- 
leased later this year, we will extend the followup period to 30 
months and will present a comprehensive analysis of program costs 
as well as benefits. 

The national JTPA study was designed to measure the effects of 
JTPA as it normally operates in order to identify those parts of the 
program that are performing well and those that are not. We be- 
lieve that the study was successful in doing this. 

The study was not designed to tell us now to improve the pro- 
gram. To do that would have required testing new service ap- 
proaches. That would have changed the way the program operated 
and run cormter to the objective of evaluating the program as it 
normally operates. 

Thus, I cannot tell you today how to make the program work bet- 
ter for out-of-school youths or for adults currently receiving less in- 
tensive services. What I can tell you is that these are the areas in 
which efforts to improve the program should focus. 

In order to decide what should be done in these areas, I strongly 
recommend further research along the following lines. 

First, I recommend that the Department of Labor look very close- 
ly at the way the JTPA serves male youths with an arrest record, 
in order to attempt to discover why the program is having an ad- 
verse effect on this group. 

Second, I recommend that alternative methods of serving adults 
currently receiving nonintensive services and all youths be devel- 
oped and rigorously evaluated. I cannot overstate the importance 
of rigorous evaluation of new approaches to serving these groups. 
Experience has demonstrated that simply trying out alternative 
program strategies without rigorous evaluation is not enough. 
Nearly 10 years ago, a National Academy of Sciences committee re- 
viewed some 400 reports on a wide range of youth employment and 
training demonstrations and concluded: "Despite the magnitude of 
the resources ostensibly devoted to the objectives of research and 
evaluation, there is little reliable information on the effectiveness 
of the programs in solving youth employment problems," I would 
submit that that statement is still true today. 

Finally, in order to continuously monitor the effectiveness of the 
program and to determine whether any of the changes in the pro- 
gram since the period we studied have substantially changed the 
effects of the program, it is important to periodically evaluate the 
existing program, using methods similar to those used in the na- 
tional JTPA study. In this connection, I should note that the De- 
partment of Labor has already issued a request for proposals for 
a follow-on study. I would hope that this study could, in some 
measure, address all of the issues I have mentioned. 

I realize that the Congress does not have the luxury of waiting 
several years for more research to be conducted, but must act now 
on the best available information. At the same time, I think it is 
important to invest in getting better evidence so that when these 
same issues arise 5 or 10 years from now, we are in a better posi- 
tion to address them. 
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Mr. Chairman, I want to thank you again for the opportunity to 
tell you about the national JTPA study. Copies of a more detailed 
summary of the study are available, and I would be glad to respond 
to any questions. 

[The prepared statement of Mr. Orr follows:] 
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rmUnyOrr, from Abt Associates. I ain very pleased to have this opportunity to speak 
to the Committee about our analysis of the effects of Job Training Partnership Act (JTPA) 
programs in sixteen local Service DeUvery Areas (SDAs) across the country.* 

The National JTPA Study 

The National JTPA Study provides the first reliable evidence of the impact of JTPA on 
the educational attainment, employment, and earnings of disadvantaged youths and adults. By 
"impact", I mean the gains or losses in these outcomes that resulted from participation in the 
program-what might be termed the program's "value added". 

We measured the impacts of the program with a method that is very similar to that used 
in clinical trials of new drugs. In each SDA, appUcants to the program were randomly assigned 
either to go into the program or to go into a control group, which was excluded from the 
program. Random assignment assures that the control group does not differ from the program 
participants in any systematic way except that they do not have access to the program. 
TTiercfore, any subsequent difference in outcomes between the program participanu and the 
control group can be confidcnUy attributed to the program. Suppose, for example, that average 
earnings in the control group wc-e $10,000 and the average earnings of participants were 
$11,000. Our estimate of the impact of the program would be a $1,000 earnings gain. 

Random assignment is widely viewed as the only reliable way to measure the impact of 
employment and training programs. For this reason, when the Department of Labor set out to 
evaluate JTPA in 1986, they ^ificd random assignment as the method of choice. More 
rcccntiy, in the 1992 JTPA amendments. Congress specified that the methods to be used to 
evaluate the program should iiKlude rarkJom assignment. 

It is important to note that, while the control group was excluded from JTPA, they were 
aUowcd to receive any other education, employment, or training services to which they were 
otherwise entitled. Thus, the beochmarlc against which we measure JTPA is the other services 



» Hjc Nttjootl rrPA Study wm conducted by Abt AMOcUtn and the Mjm|»owcr Dcmooitnlioa Re^arch 
CofpontioD, \nder cootnct to the U.S. Deputnuot of Labor. 
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available in the community, not the total absence of service. This means that our unpact 
estimates measure the incmneDtal effects of JTPA, over and above the effects of services the 
participants would have received in the absence of the program. 

This study is based on a sample of over 20,000 adults and oul-of-school youths who 
applied to JTPA Title U-A in the sixteen study sites over a 22-month period from 1987 to 1989. 
Tw>thirds of the sample were randomly assigned to go into the program and one-third were 
assigned to the control group. We collected data on educational attainment, employment, and 
earnings from both groups through a foUowup survey. The results currently available follow 
the sample for 18 months after random assigmnent. 

The Main Findings 

We performed sqjarate analyses for adult men, adult women, male out-of-school youths 
(age 16-21) and female out-of-school youths. (We did not study in-school youths.) Within each 
of these groups, we examined the e)q)erience of three different "sendee strategy" subgroups: 
those recommended for classroom training; those recommended for on-the-job training; and 
those recommended for less intensive services, such as job search assistance, basic education, 
and job-readiness training. 

For adults, the major findings were: 



For both adult men and adult women, JTPA approximately doubled the rate of 
attaiiunent of a high school credential (either a high school diploma or a GED) 
during the foUowup period; 

The on-the-job training service strategy significantly raised the earnings of both 
men and women. We estimate 'Jiat the program increased the earnings of adult 
JTPA enrollccs in this subgrou,; by about %900 per year;^ 

The classroom training service strategy significantly increased the earnings of 
adult women in the post-program period, but had no statistically significant effect 
on the earnings of adult men. The adult women in this subgroup who enrolled 
in JTPA experienced annual earnings gains of about $900 in the last sbc months 
of the followup period; and. 



^ Among thotc nmrfomly uiignod to the progrtm, 64 pcrceot carolled in JTPA. The cstimAtea preacnted here 
are our best eatimAte of the imp«ct of the prognun on thcM earolleet. 
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Neither the women nor the men lecommciKJed for less intensive services 
experienced statistically significant earnings gains over the followup period. 

For out-of-school youths, the principal results were: 

The program increased the proportion of male youths who attained a high school 
credential from 14 percent of all dropouts to 24 percent. Similarly, it raised the 
percentage of female youths achievmg a high school credential from 17 percent 
of all female dropouts to 29 percent; 

However, the program had no statistically significant positive effects on the 
earnings of female youths in any of the three service strategy subgroups or male 
youths in the classroom training subgroup; 

Enrollment in JTPA actually reduced the earnings of male youths recommended 
for on-the-job traininf and kss intoislve services by $1 ,200 to $ 1 ,500 per year. 
Further analysis revealed that these cammgs losses were almost entirely 
concentrated among male youths who reported that they had been arrested at 
some time before applying to the program. This subgroup constituted 25 percent 
of the male youths^ and only about 2 percent of the overall sample. 

Overall, then, the program appears to have had positive effects on educational attainment 
for all demogi^hic subgroups; modest positive impacts on the earnings of adults, especially in 
the on-the-job traiiung subgroup; and no effect on the earnings of youths, except for male youths 
who had been anrsted, whose earnings were reduced as a result of participating in the program. 

In viewing these results, it is important to bear in mind several things. First, the sixteen 
study sites arc not necessarily rq)rcsentaave of the nation, although they do reflect the diversity 
of programs found across the country. Second, the program experience on which the study is 
based occurred in 1987-89; a number of changes have taken place in the program since that 
time, most notably the 1992 amendments. Third, our results are restricted to the JTPA title 
servmg disadvantaged workers and our sample did not include in-school youths. Fourth, these 
findings cover only the first 18 montiis after program entry; some of these results could change 
witii longer followup. Finally, h will be important to consider these program impacts in relation 
to the costs of the program. In our final report to be released later this year, we will extend the 
analysis to 3D months and will present a comprehensive analysis of program costs and benefits. 
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ImpUcatSoof and R f o mmwi datioM 

The Natkmal JTPA Study was decigned to metsuie the effects of JTPA is it normally 
operates, in order to identify those paxts of the program that are performing well and those that 
are not. We believe that the study was successful in doing this. 

The study was not designed to tell us how to improve the progrun. To do that would 
have required testing new service approaches. That would have changed the way the program 
operated and, therefore, run counter to the objective of evaluating the program as it normally 
operates. 

Thus, I cannot tell you bow to make the program work better for out-of-school youths 
or for adults currently receiving less intensive services. What I can tell you is that these are the 
areas on which efforts to improve the program should focus. 

In order to decide what should be done in these areas, I strongly reconunend further 
research along the following lines. First, I recommend that the Department of Labor look very 
closely at the way the JTPA serves male youths with an arrest record, in an attempt to discover 
why the program is having an adverse effect on this subgroup. 

Second, I recommend that alternative methods of serving adults currently receiving non- 
intensive services and all youths be developed and rigorously eraluated. I cannot 
overemphasize the importance of rigorous evaluation of new approaches to serving these groups. 
Experience has demonstrated that sunply trying out alternative program strategies without 
rigorous evaluation is not enough. Nearly ten years ago. a National Academy of Sciences 
committee reviewed some 400 reports on a wide range of youth employment and training 
demonstrations and concluded, "Despite the nugnitude of the resources ostensibly devoted to 
the objectives of research aiKl evaluation, there is little reliable information on the effectiveness 
of the programs in solving youth employment problems."' 

Finally, in order to continuously monitor the effectiveness of the program aiKl to 
detennirie whether any of the changes in the program since the period we studied have 
substantially changed the effects of the program, it is important to periodically evaluate the 



' B«tny, ChftriM U, Robintoo G. HoUiiter, and Mmy R. Paptfoorgiou. 19SS. Youth EmployiDcnt and 
Training Procmm: The YEDPA Yours. ConunittM on Youtfa EmpIoyiDect Profruns, ConmuMtoa oq Behavtonl 
ftud SocUl Sct«oCM aimI Educadoo, NatiooAl RMOtich Council. WMhingtoo, D.C.: NatiooAl Academy ProM. 
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existing prognm, using methods similar to those used in the Nttiooil JTPA Study, In this 
connection, I should note that the Dqnitmeot of Labor has already issued a request for 
proposals for a follow-on study. I would hope that this study could, in some measure, address 
all of the issues I have mentioned here. 

I realize that the Congress often docs not have the luxury of waiting several yean for 
more research to be conducted, but must act now on the best evidence available. At the same 
time, I think it is important to invest in getting better evidence so that when these same issues 
arise five or ten years from now, we are in a better position to address them. 

I want to thank you again for this opportunity to tell you about the National JTPA Study. 
I have brought copies of a more detailed summary of tbe study for anyone who would like one, 
and I will be glad to re^nd to any questions. 
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Executive Summary 



THE National JTPA Study was commissioned by the EmploymeiU and Traming 
Administration of the U.S. Dcpanmeot of Labor (DOL) in 1986 to measure the 
impacts and costs of selected etnploymest and trainisf proframs funded under Title II-A 
of the Job Traininj^ Partnersbtp Aa of whidi is targeted to serve economically 
disadvantaged Americans. Ibtsrcpoct prcscoa Interim estimates of program Impacts 
on the earnings and employment of adults and out-of-scbool you^ In 16 local service 
delivery areas during die fint It mondu after their acceptance Into the program. 

Estimates of longer term program impaca on earnings, employment, and welhre 
benefitt, and an analysis of program com and benefits, will appear in the final report of 
the study (forthcoming, from Abe Associates Inc.). A companion report on the study's 
Implementation (Doolittle, forthcoming) describes the JTPA programs operated in the 
study sites and the types of ITPA-funded services provided to members of the study 
sample. 



The Nationil JTPA Study 

This study grew out of the recommendations of the Job Training Longitudinal Survey 
Advisory Panel, a group of nationally reoognaed experu In employment and training 
research formed to advise DOL on the evaluation of JTPA (Stromsdorfer et al., 1985 ). 
After reviewing evaluatkms of Comprehensive Employment and Training Act (CETA) 
programs, the panel oonchkled thai the OAty relUblt way to mea»ire the Impacts of 
en^loyment and training programs was to cocMlua a dasslcal experiment, in which 

xxxui 
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program tpplicants ire nndomly tssigned etUier to t treatment iroup, wfaicfa U allowed 
access to thtprogcm,ot to tcontrvi group, whiA Rindom issifmneot assures 
that the two groups do not differ systematically in any way except access to the profram. 
Thus» subject only to the uncenidmy associated with sampling error, any subsequent 
differences in outcomes between the two froups can confidently be attributed to the 
program. These differences are termed program brq>am. 

Although random assignment designs have been used to evaluate a number of 
demonstration projecu and sate programs* the Employment and TiUning Administration 
was the fust federal agency to apply this approach to an ongoing national program. 
Because of iu rigorous design* the National JTPA Study provides the first reliable 
estimates of the impacts of the largest employment and training program sponsored by 
the federal government 

In the National JTPA Study 20»60! JTPA applicants in 16 service delivery areas 
(SDAs) across the country were randomly assigned to the treatment group or the contrx)! 
group over the period November 1917 through September 1989. The earnings and 
employment outcomes of both groups were then measured through follow-up surveys and 
administrative records obtained from state unemployment insurance agencies. Dau on 
the baseline charaaenstics of the two groups were collected as part of the program in 
process, and information about the employment and training services received was 
obtained from fottow*up surveys and SDA records. 

The study sites were not chosen to be representative of the nation in a statistical sense, 
but they do reflect the divenity of local programs and local environments in JTPA. In 
panicular, the perfonnance of the sites during the study period, as measured by JTPA 
perfbnnance indicators, was not noticeably different from that of al! SDAs nationally J 



This repon provides estimatc» of the impact of JTPA Tide H-A on the earnings and 
employmcm of four larger gm^— aduU women and men (ages 22 and older) and female 
and male out-of-scbool youths (ages 16 to 21)— over the first It months after random 
assignment. Aduh womca make up 30 percent of the national JTPA population; ndult 
BMa, 25 percent; and out-of-school youdu, 23 perccat In-scbool youdu, who are not 
included In this study, form the remainiiff 22 percent 



I. tm Aff fin ■ iaiCWfiif I fer r mf iriinii tf dw UrtadyaMwidiaDSOAiMlioMtty. 
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Hie analysb is based on a subsample of 17,026 sao^e memben whose First Follow* 
iq> Survey imerview was scbeduledatleast 18 moodu after rai^^ Fbreach 
target froq;> we estiiDMed imiMKts for a number of 

of program services recommended for them and by their baseline dbaracteristics. 

Because tut study was designed to measure tibe effectt of JTPA as it normaliy operates, 
the analysis investigates which ITPA-funded services were working wdl for those 
recommended to receive them; the analysis does not assess possible alternatives to the 
existing program. By identifying those groups for whom Title Il-A b having positive 
effecu and those for whom it is having no effect— or even a negative effect—we hopevt<t 
help policymaicen in their efforts to identify those parts of the program that need 
improvement. Hiis analysis cannot, however, tell policymakers how to improve the 
program, since it does not compare alternative programs for simQu people. Rather, it 
measures only the effects of the existing program on the people it actually served over the 
study period. 

In the remainder of this Executive Summary we first provide an overview of the 
fttimatf^ effects of the program on the earnings and co^loyment of the four mab target 
groups— adult women and men, and female and male youths. We then present more 
deuiled findtogs for adult and youth subgroups. In turn, and conclude with implications 
of the fmdinp for the JTPA program and future researdi. 



OveraU Impacts on Earnings and Emplpymcnl, by Tiugcl Group 

JTPA Title n-A had gencrafly positive effects on the eamtnp and employmem of adultt 
in thestudy sites. As shown in the top panel of Exhibit S.l, access to the program increased 
the average 18-moodi eaminp of ^e adult women randomly assigned to the treatment 
group CJTPA assignees*) by an estimated 1S39, or 7^ percent of the control group mean. 
Acceu to the program also increased the percentage of women en^loyed at some time 
during the follow-up period by 2.1 percentage polms. Because these estimates are 
statistically ^gniflcant (as indicated by the asterisks beside them), we take them to be 
rdiable evidence of positive impacts on earnings. In this analysis we accept only statisti- 
cally signlficam estimates as evidence of real program effects. 

The t tt>m«#a^ program Impacts for aduh men— an eaminp gahx of $550, or 4.5 
pcrceoc, and an Incrtase la the percentage onployed of 2.t percentage points— were 
sfanllar In size lo those for adult women, but the estimated Impact on eaminp was not 
t atari tfkally tfgnfflnnr 

X Wilha HOP It mmXk «ady MpK Firtl Fttl^^ Sv^ey tfMi mt ivtikbk for 14.442 iratplc 
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Exhibit SJ Impacts on Total J84doHth Eamin$i and Employttunt: JTTA Assitntts 
and EnrotUes, by Target Gnot^ 
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In contrist to the finding for adults, the projrim had little or no effect on the avenge 
earnings of female youths (a statistically iftsignificant earnings loss of $-182, or -2.9 
percent), and the program actually reduced the earnings of male youths, on average— as 
evidenced by a large, statistically significant loss of $-S54, or -7.9 percent, over the 18- 
month period. Access 10 JTPA had DO significant effect on the 18-month employment rates 
of either female or male yobths. 

Hence, the findings for the female youths are clear-cut: JTPA had virtually no effect 
on their earnings or employment. Butthe findings for malcyouthsarelcss clear. As shown 
later in this sunrunary, almost all of the negative averag j impact on the earnings of male 
youths is concentrated among those who reported having hxa arrested between age 16 and 
random assignment (25 pert;ent of the male youth treatment group).* Thus, the estimated 
impact for most male youfis (the 75 percent widi no previous arrest) was negligible. 

The estimates discussed above are average Impacu on the earnings and employment 
of all sample memben auigned to the treatmeat group. Although all of these assignees 

^ 

3. Firt>tnw«.MMtodlMff ■tkiJiwniBwy. there li>w 
ff <i tn i h>d Car mak youtthM % pnnom mrtA. 
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were given access to JTPA; iibc:iU:Q( tficm ieiually eorolled jbi tho pcognun. Thebottom 
pinel of Exhlbii S.l presents our best estimaces of program impactt on tbe earnings and 
eoploymect ofJTPA enrotlees (assignees wbo were later enrolled).* 

Kstimatfid impacts per enrollee— both gains and Iosses--were about 60 percent to 70 
percent larger than impacts per assignee, depending on the target group. The ^tlmated 
earnings gains of adult women nnd men wbo were enrolled in JTPA were $S73 and $935, 
respectivdy . Impacts on youths were earnings losses of $-294 for females and $-1 ,356 for 
males.' The impact of the program on the percentage of enrollees in each target group who 
were employed ranged from an increase of 2.4 percentage points for male youths to ^ 
increase of 4.S percentage points for adult men. 

It is important to understand that tiie impact per assignee and the impact per enrollee 
are not two different estimates of the overall effect of the program. They simply spread 
the total estimated program effect on the sample over a larger group (assignees) or a smaller 
group (enrollees). Tbus» the two sets of estimates are entirely consistent; they just measure 
different concepts. In the remainder of this Executive Summary » we focus on the estimated 
impacts per assignee, because they are the most reliable, direct experimental evidence of 
the effects of the program. 

Impacts OD earnings reflect program effects on both the amount of timetreatment group 
members worked and how much they were paid per hour worked. Exhibit S.2 shows 
estimated impacts on the average number of hours worked by assignees and average 
earnings per hour worked over the follow-up period, expressed as percenuges of the 
corresponding control group means. The percentage impacts on these two components of 
earnings approximately sum to the percentage impaa on total earnings per assignee.* 



4. Todcri»c fttintttrt iycMPtkti. it WMii r I M M^ to t»tw>e that there wit DO impact oo^ 
•od anploymcBt orMoenrelkci. IWre it cndaoe, kowever, that about half of all noDcaroUecs had aocne 
contact with the prograio after random I iinfatiiMlrarfiwt Ml >f I iinii11yininiinal--"progiiinterncei. As 
a rcsHh, the cMiaaica ia the boiioM pand prahahly •vcrMt aonewhat the true inq^ 
ctfimated in^acta per astafDse aidmuie tW lr«e impact «■ caroUoet. Thua, the tnic impact oo csroUces 
proUblylie« a om a wfac r c licti weii1htiet»^m i mM ifi TV eaUmaig for cofoUeeaalao adjmt for Uie fact that 
3 pouBtof theooBtral tioupbacamearanad mn?A.4apiic thccxpcnmcat*t cmba^ 

S. Aa waa ma af the aatinatad impact pm aaangprnt fcr mak ^tha, tbe large, M|at)vc impact per 
oranec fi» mak ywitha is due almoai ealtfily !• a ««y larfT cMmaMd ia pact for thoae 1^ 
with a prcvimia itTtat 



4. Bacmiae the imperti m ■wamy pm haw iiwlarf «wt tatimaiad iadinctly, w« did sot ftlnilalr 
i> lagatriraf tlmiafar^amimpacm. 
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Exhibit 5.2 Ftrc^ntaz* Impocu on Tottd 19-M<mth Emmngs mU lu Campontnts: 
J7TA Assiiru€s mnd EHroOms, hy Tmrftt Grwf* 
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As shown in Exhibit S.2, the 7.2 percent increisc in etmings for adult women reflects 
1 combination of t 3.7 percent Increase in boun worked and a 3,4 percent increase in 
average hourly earnings among those who worked. The earnings gain for adult men, on 
the other hand, was entirely atuibutable to a 4.5 percent rise in hours worked, with no 
increase in hourly eaminp. 

Among female youths a -4.7 percent reduction in hours worked more than offt*^ a 
1 .9 percent increase in hourly earnings to produce the negligible impact on total ean. > 
that we saw earlier. Among male youths the •7,9 percent loss in total earnings was 
primariJy attributable to a decrease in hours worked (of *6.8 percent). 

Overall, then, fTPA appears to have had modest positive effects on the earnings and 
employment of adult women and men. But the program appears to have had virtually do 
effea on the earnings and employment of female youths utd most male youths . In contrast, 
it may have had a large, negative impact on the earnings of those male youths who had 
been arrested before they applied to JTPA. 

When estimated separately by site, positive but generally insignificant earnings effects 
were obuined in most sites for adult women tnd adult men, negative but generally 
insignificant earnings effects were obuined for male youths, and a majority of sites yielded 
negative but insignificant earnings effects for female youths (not shown here). Thus, the 
main IS-month eaminp findings by target group were found to be widespread across the 
16 SDAs In the study. And despite wide variation in the magnitude of these estimated 
effects, the sites did not differ sigmficantly from one anodier in the degree to which JTPA 
affected eaminp In any individual target group. 

In an attempt to explain the variatkm In Impact estimates across sites, we conducted 
a limitedexploratoryaiulysisoflocalfactortthatmightinflueoceprogramimpacu. Three 
typvi of factors were considered: (1) characteristla of the JTPA programs; (2) prevailing 
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labor market conditions; and (3) the types of persons accepted Into the programs. But no 
clear patterns emerged from the analysis; and almost all of the findings were statistically 
insignificant, which is probably due to the small samples at each site and the limited number 
of sites involved.*'*' 



Findings for Subgroups of Adult Women and Men 

The impacts presemed in the previous section are estimates of the average effects of the 
program on each target group in the study sample. Because JTPA provides a number of 
different employment and training services to a wide range of program applicants^ it is 
important to analyze how program impacts varied with the types of services offered and 
the characteristics of the applica^nts. In this section we therefore present estimates of 
program impacts on the earnings of adult subgroups defined by the services that program 
intake staff recommended for them and by selected personal charaaeristics. 



Service Strategies Recommended 

For purposes of this analysis, members of the study sample were classified into three 
sendee strategy subgroups based on the services that program intake staff recommended 
for each sample member prior to random assignment.^ Applicants reconunended for 
classroom training in occupational skills were placed in the dassroom training subgroup. 
Those recommended for on-the-job training (OJT) were placed in the OJT/JSA subgroup 
(so named because many of the treatment group members in this subgroup were enrolled 
in job search assistance whOe searching for either an on-the-job training position or an 
unsubsidized job). Because JTPA staff sometimes reconunend combinations and se- 
quences of services » applicants placed in either of these subgroups may also have been 
recommended for any of several other services, including job search assistance, basic 
education, work experience, or miscellaneous other services. Those applicants recom- 
mended for one or more of these services— but neither daisnram training in occupational 
skills nor on-the-job training— were placed in the third subgroup: other services} 



7. Service Kivicfy wbfroupt «fcre defuMsd bttaed on the ■cnrioes recocoinezided ratho^than the Krviccs 
received for two rcajocu. FnU il «m aol powtbk to identify oaotn) group zncmboi vdix) were companbk 
Id the treatment pxrup mc m be ra «te reccsv«d paitiatltt JTPA tovkca, irvfaereas it mot possible to identify 
ooDtfDl {roup a cmbc n wtie were twountaAcd Cor the mat tanct» as treatment group memberr. Second, 
md mott AmdamcBtalty. Bate piiniiw «aff can iw i«aa < n << lerncci bat cannot ensure that applicants 
paitkipate in thoae aovioea, rtcoaoicnded acnricca f«|ieaent (W oper^ 

t. A tew apptkaAts designated f« this ctteramrkciulbf^ 
m ocrupational ikilia or oa t h a j ob treiniat part ^^t m mmd trttaing.** 
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EsAibit SJ Servict StnUegies JUcemmemUd: 
AduU JTTA Asngnm, by Gtnd€r 
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As shown in Exhibit S.3, nearly hilf of a]l adult men in the ueatment jroup were 
recommended for the OJT/JSA service strategy, with the remainder about equally divided 
between the classroom training and other services strategies. Women were more likely 
than men to be recommended for classroom training (44 percent versus 25 percent) and 
less likely to be recommended for OJT/JSA (35 percent versus 49 percent). 

It is important to note that program intake staff recommended services based on t 
individual applicants' employment needs and qualifications, as well as their personal 
preferences. The service strategy subgroups therefore differed from one another not only 
in terms of the service recommendations but also in terms of personal characteristics. 

Enroixment Rates and Duratx)N, by Servk3 Strategy Subgro jp 

After assessment and recommendation of services, two-thirds of t^e applicants accepted 
by intake suff were randomly assigned to the treatment group, w'aich was allowed access 
to JTPA, and one-third were assigned to the control group, which was excluded from JTPA 
for 18 months.* 

As noted above, not all treatment group members woulJ ultimately become enrolled 
in JTPA. Enrollment rates differed by service strategy' subgroup, but overall they were 
quite similar for adult women and roco. Within tbt ueatment group as a whole, 6S percent 
of adult womcfi Mnd 61 pcrctnt of aduh men were enrolled in JTPA at tome time during 
the IS-iDonth follow-up period. Enrollment rates were highest in the classroom training 
subgroup (73 pertens and 71 pcrccat for adult women and men, respectively) and lowest 
in the OJT/JSA subgroup (55 percent and 57 percent). 

f. This mbino OB tcmoa Id Goali^ group oKabmwMfficocstfUlyi^ Over the coune of 

the lS.aunthfen9w^pcnod,M>y)pmciiloroalro:|nMpnen^^ 



67 



64 



Tn?AliM0KrHB4PACn/IXBCUnVg SUMMARY • xu 



* ' - The duration of earollmeitt in the program also differed by service strategy, ranging 
from a median leogdi of about 2 months for women and men in the OJT/JSA and other 
services subgroups to median lengths of enrollment of 4 to 6 mondu in the classroom 
training subgroup. Generally, there was little difference by gender in the duration of 
enrollment except that women in classroom training tended to stay in the program about 
two months longer than men. 



Services Received, iy Service Stiutecy Subcrouf v 

Within the classroom tralninz subgroup the most common JTPA services received by 
treatment group members who became enrolled in the program were classroom training 
in occupational skills, basic education, and job search assistance. Enrollees in the 
OJT/JSA subgroup were most Jikcly to receive on-the-job training or job search assistance, 
or both. In the other services subgroup the most common services adults received were 
job search assistance and miscellaneous services, such as job-readiness training. Exhibit 
S.4 shows tha between 82 poxent and S9 percent of the enrollees in each service strategy 
subgroup received one or both of the two key services characteristic of that service 
strategy. Tbus» the diree service strategy defmltions represent distinctly different mixes 
of services actually received, as well as services recommended. 

The impacts of the program do not depend solely, however, on the JTPA services 
received by those in the treatment group. Instead, the impacts reflect the difference 
between the services received by those given access to HTA and the services they would 
have received if they had been excluded from the program. That is, the benchmark against 
which we meuure the effects of JTPA is the services available elsewhere in the 
community, not a totai absence of services. Our measure of the services the treatment 
group would have received if they bad been excluded from the program is those received 
by the control group, who were excluded from the program. 

Since we measure Impacts per auignee (treatment group member), the relevant 
compirison is in terms of services per auignee, including those who were never enrolled 
in JITA. As expeaed, the largest treatment-control group difference in tl^e dassroom 
training subgroup was in receipt of classroom training in occupational skills. Among adult 
women 49 percent of the treatment group received this service, whereas only 29 percent 
of the control group did. Among adult men these figures were 40 percent veaus 24 
perceoL 

Adult treatmem group memben in the OJT/JSA subgnxq> were much more likely than 
control group members to receive on-the-job training. We estimate that 29 percent of the 
women and 27 percent of dM men Id dkt treatment group in diis subgroup received OIT, 
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Exhibit S,4 Key JTPA Services Received by Ttecment Gwup 

Members Who Were Enrolled In the Protrom: Adults, by 
Gender and Service Strategy Subiroiqt 





% of enrollees receiving 
one or both services 




Adult Adidt 


Key services 

In service strategy subgroup 


women ^ men 
fl) ^ (2) 




Qassroom training subgroup 


Clusroom training in occupational 
skills/basic education* 


88.8% 85.5% 




OJT/JSA subgroup 


On-the-job training/ 




job search assistance 


87.8% 86.5% 




Other services subgroup 


Job search assistance/ 




miscellaneous* 


82.3% 88.7% 


Sample size 


2,883 2,286 



*BMk aducMiM* mcX^tdm Ad^ Buk EddcMioa (ABE), kifh tctoel or Omtn^ Edncmiomi 



job ftedovviBf . Mid ujwa mipkrpmtA^ MKMf ote MrvicM. 

whereas less than \ percent of the correspoDdi&f control groups received this service, ihwe 
. OJT b typicaHy not funded by ooo-JTPA provWer*. We were not able to measure control 
group receipt of job search assisunce from non-JTPA trovidea, and so we could not 
estimate the treat meiU-<ODtrot group difference for that service. 

As noted earlier, the most common ITPA services provided to adults in the other 
servica subgroup were job search assistance and miscellaneous services. Around 25 
percent of adult trcatroem group roetnben in this subgroup received the former service, and 
about 30 percent received the tatter. We were unable to measure receipt of these services 
from nOQ>nTA providen and therefore cannot estimate the treatment^btrot groq) 
differtace, y ' .'^f 'T'.. 

mrafffit>musmfe&^c^^ 

4»minuni)y£Mj[tt^ 
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Among adult womeo axtd in«n the tvenge mtgnee in tib« dasnoom training subgroup 
(T^egivwi^W iltt additigpal 95 to ^.^OjKimtrf dissroo0jn^ in occupational skills, 
' iHM me avM^e assignee in the OfTfJSK suSgroup likewise received only an additional 

104 to 114 hours of on-tiie-Job training. 



Impacts on Educational Attainmekt, iy Service Strategy SifflCROUP 

An intermediste effect of the increnieat in services received by treatment group members 
was an increase in educational anainment among those v/ho were high school dropouts. 
Dropouts made up around 30 percent of the adult target ^'roups. Our analysis focuses on 
the anainment of a tralnin^-rdated hxih school credential v^ich we define as both having 
received a school or training service and having received ii hlsb tdiool d^oma or General 
Educational Development (GED) certificate at some time during the IS-month fbUow-up 
period. 

As might be expected, the inaease in educational attainment was greatest among those 
dropouts recoounended for the dauroom tralnlni service strategy. Exhibit S J indicates 
that nearly 30 percent of the adult dropouts in the classroom training treatment group 
received a training-related high school credential, whereas only 11 percent of the control 
group did--for impacts that were highly significant in the cases of both genders. There 
were smaller, but still statistically significant, increases In the proportions of female 
dropouts in the other services subirwp and male dropouts in the OJT/JSA subgroup who 
atuined a high school credential as a result of the program. But there were no significant 
effects on educational atuinroem anwog women in the OlT/iSA subgroup or men in the 
other services subgroup. 



EzAifrti 5. 5 hmpmcu m Attmiitmtnt tfm TrmMing'nttMt^ High Sehoot Diplctna or CED 
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Impacts on Earnwos, by Service Stxatioy Suborouf 

Exhibit S.6 shows the estimated pro^rim impicts on the earnings of adult women and men 
in each service strategy subgroup. As shown in the second column of the top pand of the 
exhibit, impacts on the earnings of adult >vomen in the classroom tralniiti subgroup 
followed the expected pattern for this type of service: aa earnings loss in the first quaner, 
representing an initial investment of time in training, followed by a payback period of 
rising earnings gains in the next five quatters, with statistically significant gains of $144 
and $188 in the last two quarters of the follow-up period. The oveiall 18'month earnings 
gain of $398 for women in this subgroup was not statistically significant This gain 
reflected an estimated 8.9 percent program-Induced increase in the hourly earnings of 
those women who worked, which more than offset an insignificant -2.5 percent drop in 
the average number of total hours worked by all adult women over the follow-up period 
(estimates not shown in the exhibit). 

The estimated impacts on the earnings of adult men In the classroom training subgroup 
are less dear. None of the impacts on quartcriy earnings was significantly different from 
zero, nor was the overall impaa on total earnings over the follow-up period.. Moreover, 
the program had do significaat impaa on the employment rate or hours of vrark over the 
follow-up period for this subgroup of men (ettimatet ooc shown). Thus, there ii 
evidence of a program impact on the earnings and employment of this subgroup. 

In contrast to the pattern for women in the classroom training subgroup, women in the 
OJT/JSA subgroup (middle panel of the exhibit) experienced an immediate and susulned 
positive impact on average earnings throughout the follow-up period, as might be expeaed 
with a strategy that emphasixes immediate placement in either an on-the-job training 
posiUon or a regular Job. Women in the OJT/JSA subgroup had significant quarterly 
earnings impacts of $ 109 to $ 1 44 in five of the six quaners, with a significant gain of $742 
over the follow-up period as a %irhole. 

Men in the OJT/JSA subgroup experienced estimated gains of similar magnitude in 
five of the six quaners and over the follow^ip period as a whole, although the estimated 
impacts were less often sutistically significant. Over the 18 months men in this subgroup 
experienced sigrificam earnings gains of $781. 

»'t * . ■ • 
Both wooco and men b the OJT/JSA subgrtHtp experienced a positive and significant 
Impact 00 hours worked; and men, oo their employment rate (estimates not shown In the 
exhibit). Indeed, the earnings gains of both womer; and men in this subgroup were due 
primarily to Increases In the number of hours worked per sample member, rather than to 
higher bouriy earnings while employed. — 



71 

BEST copy AVAILABLE 



68 



. '. 4fy<- A n i fm ^ m , hy C m it r mU Smyk* Snrntgy StAgrony 





«... Adidxwc 




Addtw 


Ml 




Cmtitvl 




Cmtrcl 


JmfMct p<r 










mmgneie 




0) 


a) 


0) 


(4) 






Oaisroom f routing mhgrxmp 




Quarter 1 


S 7U 


$ -TO* 


S 1,440 


$ >101 


2 


m 


5 


1.714 


126 


3 


1.066 


52 


l,tS4 


213 , 


4 


1.189 


79 


2.1S4 


50 ^ 


5 


1.253 


144»* 


2.171 


151 


6 


1.230 




2,317 


-21 


All quuter* 


6.391 


391 


11.710 


411 


SampUnzt * 




2,$47 




2,057 






OJT/JSA mSgrxm^ 






$ 1.143 


.S 144»»* 


$ 1.757 


S 54 




1.379 


tl 


2.014 


135 


3 


1.449 


U9-" 


2.133 


164» 


4 


1420 


109* 


2,199 


94 


5 


1.546 


142»* 


2,113 


133 


6 


1.570 


13l»« 


2.169 


201" 


All quftitcrt 


1.607 


742** 


12.456 


711* 


SampUsizt * 




2.2*7 




2.250 






Or A<r strvicts subgroup 




QuAJter 1 


S 960 


t 39 


S 1.677 


$ 74 


2 


i.m 


132 


1,951 


104 


3 


1.2a 


220" 


2,123 


44 


4 


1.471 


22 


2.199 


44 


S 


1.535 


2 


2,292 


13 


6 


1.5tt 


42 


2.r4 


.19 


All quvUfi 


7.960 


457 


12.516 


261 


Sample JUt * 




1.340 




JJI2 


A AMifWM Mi CMir 














M Ji (M 







69 



XLVI • JITA It^fOKTH IMPACTS / IXECimVB SUMMAItY 



In contrast to the sustained, positive tmpaaon earnings in the OTT/JSA subgroup, the 
program appears to have bad only a shott-Itved effect on the earnings of adult women, and 
virtually no effect on the earnings of adult men, in the other services subiroup (bottom 
panel). JTPAbad a significant impact on women's earnings of $220 in the third quaner, 
followed by much smaller, insigniticant gains in the later quarters. Hie estimated impacts 
on hours worked quarterly (not shown) mirrored this pattern— possibly reflecting quicker 
placement in jobs that were similar to those the female assignees would have eventually 
found without access to JTPA. For men in the other services subgroup, neither the 
estimated impacts on quarterly earnings nor the estimated : nipacts on hours of work (not 
shown) were statistically significant. ^ v 

Overall , then, JTPA led to modest, statistically significant earnings gains in at least one 
quaner for adult women in all three Mrvice strategies. The timing of impacts was very 
different across the subgroups, however, and significant for the follow-up p«iod as a whole 
only in the OJT/JSA subgroup. Significant impacts on the earnings of adult men were 
concentrated exclusively in the OTTAISA subgroup. 

It is important to iterate that the adults in the three service strategy subgroups differed 
not only in the services they received, but also in their personal characteristics. Program 
intake staff tended to recommend the most employable applicanu for the QJT/JSA service 
strategy. This difference is evident not only in the dau on baseline characteristics of ^ 
three subgroups (not shown here) but also in the earnings of control group members o . 
the followHjp period, shown in columns (1) and (3) of Exhibit S.6. These figures indicate 
that in the absence of program tervicea women reoommeoded.<x OJT/JSA^irauklJuye 
earned substantially more than those reoommeaded for dtssroom training and somewhat 
more than those recommended for other services. Among men the more^dt££eady 
applicaott teaded to be recommended for either OJT/JSA or other servicei; tboie nule 
control group memben recommended for classroom trailing earned somewhat l4tl.9ver 
the follow-up period than either of the other two subfRMpa, 

Because of these differenca in the three subgroups, one cannot extrapolate the impacts 
for one service strategy subgroup to the women or men served by another. We cannot, 
for example, conclude that the program outcomes for adult men in the classroom training 
subgroup would have been better if Instead they had been recommended for the OJT/JSA 
service strategy. We can only determine %yfalch service strategies were effectivejbrrAoje 
appiicants recanmended for them. Whether another service strata would have been 
more effective cannot be determined on the basis of this itudy, since we did not observe 
ahernathft service appfoacbcs applied to comparable p4Uticipai)t popula^^ 

«... ' i. .V <*n" ; r,,t ' r^:*\^ ... 

It Is also important to bear in mind that the costs, as wdl as the impacti, o f the three 
service strategies were likely to have varied, as may the longer term Impacts. iRSniB 
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Impacts on EAJtNXNCs, by Etwoctty and Bajuuem to Employment 

hi addition to die three subgroups defined based on service strategy recommendations, we 
estimated program impacts on the 18-month earnings of a number of other subgroups of 
women and men, defined in terms of personal characteristics measured upon dieir appli- 
cation to the program. These estimates helped xis determine whether the impacts of the 
program were concentrated within certain groups of interest to policymakers and program 
planners or broadly distributed across all adult women or men. In this Executive Summary 
we present the results for two such key subgroups: the major ethnic groups, and groups 
facing different barriers to employment.^ 

Exhibit S.7 presents the estimated program impacts on the earnings of white, black. 
and Hispanic women (column 3) and men (colunm 6). Among women the estimated 
^ « impacts j^)pear to have differed noticeably by ethnic group, with white women showing 
' significant earnings gahis of $723 over the IS-montfa fbllowHip period; black women, an 
insignificant earnings gain of $457; and Hispanic women, an insignificant toss of $-414. 
Moreover, separate tests of the statistical significance of the differences among these 
impact estimates (not shown) indicate the differences were sutistically significant at near- 
conventional levels. The estimated tmpacu for adult men also differed by ethnic group, 
but neither the estimated impacts for individual ethnic groups nor the differences in impacts 
among the subgroups were statistically significant and therefore could have arisen by 
chance. 

In an attempt to narrow the range of possible explanations for the differences in 
estimated impacts for women in different ethnic groups, we estimated adjusted impacts that 
controlled for differences in the distributions of these subgroups across smdy sites and 
across service strategy subgroups. When we control *ed for differences in the distributions 
of the three ethnic groups of women across the study sites, die estimated impacts for these 
groups were not significantly different from one another. This fmding suggests that the 
differences in estimated impacts among women In different ethnic groups are in part 
attributable to differences in the dlstribuiions of these groups across sites. In addition, 
given the extreme concentration of Hispanic women in i few sites we cannot reliably 
distinguish negative effecu on Hispanic women as an ethnic group from negative effects 
on all women in one or oaore of the sites In Miich Hispanic women were concentrated. 



10. Other key subfrot^c cxAfluaed ia report mdude deCiied by %K>rk and trabbf histories, 
public •*«if*yt*^ kiAonet, boutc^d iacomt md coaopoMUoa, public boosmg itAtus, uid «|e. 
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ExkAitS.7 Impair cnt)^2S-A4cmthEmmni$<^U^h^XMcGnm^' AAUtJTfA 
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*. iKMin ^ ci^c tmp* Amkm ladiMt, Aliiriun Naihrw, AaMt. Padfie blMilan. 

To detennine whether the effects of the program varied with the degree of labor market 
disadvanuge, we also estimated impacts od eamiogs for subgroups defined by three 
barriers to emp'ioymeot: wrifare nceipt, limited education, and limited recent work 
experience. " The first three pain of rows of Exhibit S.S show the estimated Impacts on 
earnings for women and men facing each of these barriers and for those who were not. 

The mean 18-month eanungs of control group membea, shown in columns 2 ano ^ of 
the exhibit^ illustrate thrt these barrien were indeed serious obstacles to employment. 
Control group members in all three subgroups facing these barriers earned much less over 
the follow-up period than those who were not. 

Among both women and men the estimated impacts tended to be larger for those not 
facing the barriers in question^ although among women the differences in impacts between 
those facing and those not facing a particular barrier were smaller than the differences 
among men. Separate tests for the significance of these differences between each pair of 
estimates indicated, however, that any differences shown here may have arisen by chance. 

Because some persons who were facing oi^ of these barriers to employment may also 
have been facing one or both of the other barriea, these subgroups overlap to some 
degree. To achieve a dearer distinction among the subgroups In terms of die overall 
difficulty of becoming employed, the bottom panel of Exhibh§..S categorizes the women 

AMiMMOC,VMqro<kflrc^««itebaefiiBii^«[iplkatioBto IMiM/«AK«ltoiik defined at kek 
of i hitll dipkHM V (SD MftilkMc; iinM rvMMT 

^\^^$ndt%'m^y€mpncit^9^itija^}[AnTK ThMC three mttmam cf Wnfania c m p k o w t if< 
moSm U IhoM weA ote rm^ ^tadka orJn'AprogT«M(McUS. OoMral AfiO^Uf^ > 
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and men in the simple by the number of these birriers they were ficin^. Again, the 
iverage earnings of the control groups tndtcitc thit this citegorization is strongly 
predictive of whit JTPA assignees would hive earned without the program: control group 
earnings fill steadily is the number of barrien rises. 

For both women and men the impacts were the largest in the subgroup facing none of 
the three barrien. For oetther women nor mea» however, were the differences in impacts 
omoni subgroups statistically f.tfnificint; tfaus» these differences may merely reflect 
sampling error. ° 

StAOblAJtY AND COMPAIUJON WTTK Pft£V30US FINDINGS 

Overall , JTPA Title n*A had a modest poaitive Impaa on the earnings of adult women over 
the ft>llow-up period: oo avenge, a slgnlficim giln of S539 over the 18 months following 
their application. Hm fttlmaffid Mraltgs gala for mea was atmOtr ($550) but was not 
statbtlcaily ilgnlfkaat Ttec overall tvcragn oiask substantial variation in both the 



12« Aac«gthcftduhlcaAkwbpm^ivci(aiipk,fla«isa46pon^ 
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magnitude and time pattems of program impacts among subgroups of women and men, 
however. 

When adult womco'afe'ottq^bnzed by the service strtteg y recommended by program 
intake staff, the only ones to experience a statistically sigoiflam earnings impadt over the 
fbllowHip period as a whole were those in the OTT/JS A nibgroop, with a pin of $742. 
Women in thU subgroup enjoyed consistently positive, statistically significant earnings 
increases of $109 to $144 in five of the six follow-up quarters. Women )n the classroom 
training subgroup experienced an earnings loss in the first caleodu quarter of the follow- 
up period, followed by growing positive impacts, and culminating in significant impacts 
of $144 and $188 in the fifth and sixth quaiten. Program impacts on the earnings of 
women in the other services subgroup were significant only in the third quarter, when 
these women gained $220, on average; impacts for this subgroup were negligible in 
subsequent quaiten. 

Impacts for adult men were similitr in nugnitude to those for women, although they 
were lest frequently statistically significaot. As with the women, only those in the 
OJT/JS A subgroup enjoyed significant earnings gains (of $78 i) over the fbllow-up period 
as a whole. Estimated impacts oo the earnings of nt$n in the classroom training and othe^ 
services subgroups were never statistically signiftcant, either for the follow-up period k 
a whole or fbr individual quarten. 

These impaa estimates are similar in magnitude to those found in the few previous 
evaluations that have used rigorous experimental designs. For example, studies of state 
work-welfare programs for women in the early 1980s found significant positive impacts 
in the first two years after random assignment that ranged up to about $250 per quarter.^ 
Evaluations of demonstration programs fbr displaced workers in Texas and New Jersey 
found simil ar impacts on the earnings of men— that is, in the same range but not statistical ly 
signi5cam— In the first year after random assignment.^ 

Comparisons with the results of earlier studies are complicated, however, by the faa 
that the programs involved in those studies provided somewhat difTerent services from 
those in JTPA and served primarfly subpopulations such as welfare recipieou and 
(for men) displaced workers and ex*addicts. Moreover, theprograms for wonoen examined 
in earlier studies were, vnlike fTPA* mostly inandatory, and yet bad lower rates 
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. ^ Roallyt when adult womea in the Natk>ial JTPA Study sample were classified by 
cthuk gm^p diflcreDces is cstixnited impacts oo einims were emei:|ed, with white 
womea experiebcinf gains than miaori^ women, particulariy Hi^anic women. 
Fuither tests revealed, however, tfaM these diffectoccs in impacts may well have been due 
to thecooceotmiott of Hispanic women hi a few sites that experienced impacts 
substSDdally below the averafe for an women. There were no sifnlficant differeoces in 
fanpacts on dlie eamtnfs of adult men by ethnic t^oap. Impact M^m^f* for adults who 
were and were noc subjea to variotu barriers to employment were not sutistically 
sifnificamly different from each other. But the pattern of estimates for these subgroups 
suggested that JTPA prtxluced larger positive impacts for adults wi& fewer labor marlcet 
barriers. ' ^ 



Findings for Subgroups of Female and Male Out-of«School Youths 

Out*of*scfaool youths in the study sample were classified into tht same three service 
strategy subgroups as those used to classify adults: classroom trvning, OJT/JSA, and 
other services. These subgroups were based oo the JTPA services recommended for 
sample memben by program intake staff before random assignment. 



Service Stkatbcces IUoommeindco 

The service strategics recommended for youuu reflect a difference in emphasis between 
JTPA Title II-A programs for youths and those for adults. Programs for adults emphasize 
employment, as evidenced by the faa that program perfonnance standards for adults are 
based largely on job placement rates. In contrast, programs for youths emphasize a broad er 
range of OLtcomes, whh performance standards for youths based in part on ''positive 
terminations,* which include not only Job placemcDU but also partldpatton in further 
tralnhig and mainnynr of specific )ob compcuncies. 

A comparison of Exhibit S.9 and the earlier Exhibit S.3 indicates that youths were far 
leu likely than adults to recommended for the OJT/JSA stratety, especially if we 
compare female youths widi female adults and male youths with male adults. Of the three 
service strategies OJT/JSA places the revest emphasu on immediate employment; thus, 
this diflfcrence between youths and adults refleco the difference between JTPA programs 
for the two age gro^». In addition, youths were much more apt than adulu to be 
recommended for the ether unices motto, as discussed below, also differed 
between the two age groups in the oOx of program services received. 

Service strategy recommendations also differed between female and male youths 
thcmsdves. Female youths were more llkdy than male youths to be recommended for 
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ExhihU SS Service Strategies Recommended: 

OutH/Sfhool Yoiah J7TA AssiiM^es, 
by Gender 
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classroom training (44 percent versus 30 percent, respectively) and less likely than male 
youths to be recommended for OTT/IS A (23 percent versus 33 percent). The genders were 
about equally likely to be recommended for other services (33 percent versus 37 percent). 



Ehroixmekt Rato and Duilation, lY Servicb SxRA-recY Subgroup 

Enrollment rates overall were comparable to those for adults, with 65 percent of the female 
youth treatment group and 67 percent of the male youth treatment group becoming enrolled 
in JTPA Title D-A at some time during the IS-momh followmp period. Treatment group 
enrollment rates were highest in the dass^wm training subgroup (71 percent for females 
and 75 percent for males). The lowest enrollment rates were in the OJT/JSA subgroup 
(57 percent for females and 5t percent for males). The other services subgroup fell 
between these two extremes, with enrollment rates of 63 percent for female and 68 percent 
for male youth treatment group memben. 

Oit-of-^cbool youths wbo cnroned ia JTPA stayed lo.^progrtOQ sllg^itly iohgtc^an 
^r aduh cb uBte rp a h iT wtt ttdhadMra ur&gp'ofw^ 

t^^'fioMkl feFiiffttPk Tbot, Iht median duratkw of enrollment. was also ilightly 
longer fx fcmileihas for Bale xoaiht« Ibe iervk« Aratcgy subgroup whfa the shortest 
enrollments wu OJT/JSA« with a median of cuxwft 2 naoothi for bodi females and males; 
the classroom training subgroup had the lotigest enrollments^ at 53 months for females 
and 4.6 months for malet. The median for the other services subgrm^.was about 3 months 
lor both target gTOupt«:*j>< 
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Services Received, by Service Stiutecy Subcrou? 

Exhibit S.IO shows the percemue of emollees in each service stmesy subgroup who 
received one or both of the key services in thst scrvke strategy. About 86 percent of femile 
youth enrollees and about 10 percent of male youth cnrotlees recommended for classroom 
training received classroom training in occupational skills, basic education, or both. 
About 85 percent of the female and male youth enrollees in the OJTT/JS A subgroup received 
on-the-job training. Job search assistance, or N)th. And about 80 percent of the female 
and 83 percent of the male youth enrollees in ^..e other services subgroup received basic 
education, miscdlaneous serHces, or both. 

The only obvious dlfTertocc between the mix of JTP A services received by youths and 
the mix received by aduhs was in the other scrvket subgroup. Whereas adult enrollees 
ia t^is subgroup received nuialy job searti) assistance and miscellaneous services (Exhibit 
S.4), the youth enrollees received noinly basic education and miscdlaneous services- 
further evidence, as noted earl ier , that JTPA emphasixes Immediate employment for adulu 
oaore than it does for youda. 
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As with the adults In our sample^ the estimated program Impacts on youths reported 
below reflea differences in the employment and tninin| services received by treatment 
group members^ who bad access to JTPA, and the services they would have received if 
tiiey had been excluded from the program, as measured by data on control group members. 
And as with adults, the size of these treatment-control group differences in service receipt 
varied by service strategy subgroup. 

* In the classroom training subgroup about 4S percent of the female youths and <L 
percent of the male youths In the treatment group received classroom training in 
occupational skills, whereas only 31 percent of the female youths and 22 percent of the 
male youths in the control group received this service. In rb^. Ojf/JSA subgroup about 
30 percent of the females and 31 percent of the males in the ti T^ent group received on- 
the-job training, while less than 1 percent of both females aoci males in the control group 
received the service. 

We were unable to measure the control group's receipt of miscellaneous services--the 
most common category of services received by youth treatment group members in the other 
services subgroup, at 29 percent for females and 35 percent for males. It is therefore not 
possible to determine the treatment-control group difference in service receipt for this key 
service in the subgroup. The service difTeremial was small, however, for basic education, 
the other key sr vice received by youth treamiem group members who were recommend" 
for the other set v:^ strategy. About 23 percent of female youths and 14 percent of m 
youths in the tre^ment group received basic education, while 19 percent of the females 
and 12 percem of the males in the control group received k. 

Thus, JTPA produced a noticeable increment in service receipt in the two service 
strategy subgroups for which we could measure the differences: classroom training and 
OJT/JSA. In the third, other services^ we could not measure the treatment-control group 
differential for the most common service received by the treatment group and found only 
a slight differential in the case of the other key service. In terms of the average number 
of hours of services received, JTPA produced a modest increase for the two subgroups for 
which we could measure this effect Female and male youths in the classroom training 
subgroup received, respectively, lt7 and 127 more hours of classroom training in 
occupational skills than they would have if JTPA were not available, while female and 
male youths in the OJT/JSA subgrC'Up received, respectively, an additional 105 and 12S 
boun of on-ihe-Job mining. . . 

.. htrM:nohEt)UCMW3Hja.ATtAa%sMHt.wrSwKAa 

- DiffereiKrcs In the servloea received by youths to the tre|$meft|odq^^ 
diffcrtoccft in the rate M which high school dropouu in these groups aftttlned/|high iGb^ 
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dtploma or GED cmifiote. Siiscc half of the female youths fax the study sample and three- 
filths of the male youths were high school dropouu. fanpr^ict on ^eir educatioaal 
acoiliuneat represent an important rcsoh of the pro^nns. 

As shown in the fourth row of Exhibit SAX, amonx control froup members who were 
dropouts 17 percent of the female youths and 14 percent of the male youths both enrolled 
in a school or training service and received a high school diplona or GED certificate at 
some time during the Ift-month fotlow-up period. Annong the corresponding treatment 
group members, however, 29 perccot of the female youths and 24 percent of the male 
youdis subsequently attained a traininf-reltted high school credential. The program 
impact in both cases was highly sifniAcanL Impacu were also statistically significant for 
male youths in all three service strategy subgroups and for females in the classroom 
training and other services subgroups— die two service strategy subgroups that focused the 
most on basic education. The impaa was particularly striking for female youths in the 
^ classroom training subgroup. 

Impacts on Eajininos, iy Sejiv« SntAiioy Si»croup 

As noted at the outset, the estimated program impaa on the earnings of female youths 
overall was negligible; the bnpact cm male youths overall was substantially negative, but 
that Impact was largely cooccatrated among those male youths who reponed having been 
arrested between their sixtee«xth binhday and random assignment. Exhibit S.12 provides 
a more detailed undcrstaxKling of these findinp by presenting estitnates for the three service 
strategy subgroups of youths during each of the six quaners of the follow-up period. 
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^iflMie tofcU loMc probiUy niOect the mnOagt forgow by ti««iDMt poup memben 
. w«««tttdir"ctat«.. U«likethe«xpedeoceof«diiltwoq>«o.how.5^. fenule 

ta the .foBow^ipj5«iod^ pwidpattog in 

moDth follow-«p. 

FenuJe youths in the OTTOSA subfroup expedeoctd a differait pattern. The inUial 
impacts on their eaminss were moderately positive (and statistically significant 'm the 
second follow-iip quaner). which may reflea an initial boost in eavloyment produced by 

on^he-job training, job search assistance, or both.- But flKse shott.*im Mins were not 
.sustained over time. ■ 

Program impacts on the earnings of femaleyouthsintheotterw/vfcejjuigro^pwere 
negligible in all six fbUow-«p quartea. In other words, the mix of predominantiy 
miscellaneous services and basic education that JTPA provided to this subgroup had little 
or DO impaa. 

The impact estimates (or male youths in the dassroom tralnint ttAfroup were similar 
to those for their female youfli countopam. . Invactt were substantiilly negative and 
statistical y significant in the f«t follow-up quarter, again, perhaps reHecting the costs 
of being in class instead of employed. And as with female youths, the later follow-up 
quarters brought no earning increases large enough to offtet the initial loss. 

Impacts on male youths in the aJTl/SA nbf roup were negative in all six follow-up 
quartm. Ovff die follow-up period as a whole the On-/JSA itrMffy 

signlficintearninp loss of$.1313,or-l0.3p«c«ofthecotrespoodlng control fioop-s 
mean earidngs. ni» loa rtfl«cted mainly u catiaated -«.5 pettent program-induced 
reducdoa to the avenge ■tmber of houn wnted by oaleyouttt; average hourly earnings 
among those who worked were largely unafTeoed by die program (not shown in die exhibit). 

♦ . 55^ ' In the orter tenicet sybtmup expedenced an estimated earnings loss of 
J-1 .M5, or -1 3.3 percem of what dielr earnings would have been without access to JTPA 

■ms loss reflected mainly percent reduction intheaverage number of hours worked 
alAough average hourly earainp when working were also reduced by an estimated 0 
percem (not shown)." 



p«reoiMe m>l>«» « total cmiap b««iic «h« rd,b^^ 
■u l tiplifilivc, in 
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For these last two service strategy subgroups of male youths* it therefore appears ^tt 
the negative program in^>aa on ean^ngs reflected mainly a negative program impact on 
the number of hours woriced* as <^posed to a n^ative impaa on the hourly earnings of 
those who woriced. The next subM^tion wOl also demonstrate that the negative impacts 
on earnings for the 0JT/7SA and the other services subgroups of male youths are 
attrHHitable primarfly to a large negative estimated impaa on the earnings of those male 
yoilths with a previous arrest who were recommended for each of these two service 
strategies.** 

V 

!t is Imponaot to bear in mind that although this analysis by service strategy subgroup 
is illuminating* one cannot interpret the findinp for one service strategy subgroup as 
having direct implications for the youths reconunended for one of the other two service 
strategies. Again, we can only determine which service strategies were effective for those 
applicants recoomsended for tiiem, because the three service strategy subgoups differed in 
the personal characteristics of their members. 



_.ImFACTS oh EaIINPW. Wy EtWIOTY, BAMOltS T0,EmPL0YM£NT, ANp 

Rcrorru) Ammisti 

The estimated program impacts on earnings for out-of-school youths did not v^y 
systematically with the ethnic backirounds of sample memben or with the barriers to 
employment they ftced when they applied to JTPA. 

Exhibit S.n presents the estimated program in^>acts on yvhUe, black, and Hispanic 
youths. The impaa estinutes for female youths dkl not differ substantially by ethnic 
group* and no etfuic group experienced a statistically significant impaa. in addition* 
separate tests of the statistical signlftcance of the differences among the impacts on these 
groups (not shown) confirm the lack of a differential cffea of JTPA. For the male youths 
there were differences In estimated impacts among ^e three ethnic groups, but these 
differencu were not statistically significant and may therefore have been due to chance 
(test not shown). 

Exhibit S J4 preseau the estimates for subgroups of youths defmed in terms of the 
three specific barricn to employment lnvesti,««ted for aduhs: y^\fare receipt, limited 
educatlotu$Bd limited recent work experience. As was the case fbr adults> these1>arriers 
reprcscsted serious oUtadea to coi^ymeat for youdu/as evidenced ty die' fkt that 

• ^' .^0W t>»U KH) , 



' M tlirtf tkM 1^ —fc mtl\n —1 miinii tHy iMipiififl wtkMlfiil ktfmft m Ihi wniimff nf mill 
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control group eaminp drop markedly is the number of barriers Increases (bottom panel 
of the exhibit). 

There was no statistically significant relationship, however, between the number or 
nature of these cmploymett tarriea and-Ae effea of JTPA"On-outK)f«s^^ 
Amonf female youths, b particulu, there was little difference betweep. the estimated 
program Impaa on sample members who heed each of the three employment barriers and 
those who did not fiice that barrier. Furthermore, there was no clear panem in the 
relationship between ttie estimated program impacts and the number of employment 
barriers faced. Tests for significant differences in impacts among subgroups (not shown) 
revealed none that was statistically significant. 

Among male youths the differences between the impact on sample members who faced 
a particular employment barrier and those who did not appear to have been more 
substantial. For male youths with limited education or limited recent work experience, 
JTPA appears to have reduced the earnings of those fKing one of these two barriers by 
more than it reduced the earnings of those who did not (top panel, column 6). In addk.V.n, 
the more barriers feced, the more JTPA seems to have reduced earnings over the follow^ 
up period. None of these difTerences in impact estimates between or among the subgroups 
were statistically sigmfkant, however, and so ttie patterns they imply are oniy suggestive 
and may b faa be due to chance. Moreover, the difference in impacts was in the opposite 
direction for male youths receiving wel^e and those not receiving welfare. 

V&^-Af2n^ tiTe moA mQ^ng'subgroup dlffarnidi* tor youths was between the impactt 
MriatedKrlnale youths wbo had been antsted before Asshown 
in Exhibit S.IS, 00 avenge, oule youths with a previous arrest experienced a highly 
significant $-3,031 program-induced eaminp loss during ttieir 18-month follow-up 
period. In contrast, male youths without a previous arrest experienced an insignificant 
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$-224 etn>mgs lou. The difference between these two impaa estimates was highly 
significam and did oot change when we controlled for the distributions of the two 
subgroups across the study sites and service strategy subgroups. 



Moctovcr, this differcflct appeared In all six follow-up quarten, all three service 
strategy subgroups, and 13 of the IS study sites where youths were included in the sample.*^ 
The negative impaa on the subgroup of male youths with a previous arrest (25 percent of 
the male youth treatoMol group) accounts for S2 percent of the program-induced earnings 
loss for male youths overall. 

based op oar Flm FodovM^ Swty (dMj^is^for tfl the inqxact estimates In this report), 
dlffo' substantially from oorrcDOodlog fanpkt'^cstifflata^r 
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administrstive records of state unaoployment ttmirance agerftes." Impact estinuues based 
OD UI earnings datt for a subsample of the 18>xnonth study sample suggest there was 
virtually no program impaa on the earnings of the previous arrestees among male youths. 
Ahbovgb there is^toawquettkttabomthed^ee to wfaichJTPA/)^^ the earnings 
^.dKMe maleyoutitt'wiib«pr«vk)yt arrest* both data sources agree tbA the program <M 
^o$Jb%atost (belr eanibgs,' or (be fr^'"gi of male youths overalL 

We will explore further the differences in the estimates from the two data sources in 
our forthcoming final repoct. The impaa estimates from the two dau sources do not, 
however, differ appreciably for adult womer, adult men, female youths, or those male 
youths who did not report a previous arrest. 



Summary ahd Compaiusoh wrm Previous Findings 

The preceding analysis has shown that JTPA Title II*A did not appreciably affect the 
earnings of female out-of-scboo) youths. On average, the program reduced total earnings 
during the 1 t-mootfa followHip period by S- 1 82 per female youth assignee (treatment group 
member), but this effea was not statistically tignJftcant. Nor were the impact 

c^mates statistically signifkaot for female youths In each of the three service strategy 
subgroups or in any of the subgroups defmed by personal characteristics. 

The findings for male out-of-scboot youths are very different. On average, JTPA 
reduced the estimated earnings of 6is target group by a statistically significant $-854 over 
the ll*moiith lbtk)w^ pcrM. But wxt of this negative estimated impact was 



11 ApfMftdixEcxmiMil^iinL Aft AicvMtf tlim, ^ np^ lindinfs fcv mtk youths with » 
preview MTtM dtOer bcrwwa iW tc/« Ama nrntm tec*uM Mrainp d«u oo the trettmeot froup and the 
fiMHTDt gre«v of mk yvA wumw 4»Dm b t>«t ca the r«« 4^\m Murcct. 
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coocentrated among the 25 perctot of mile youths who htid t previous irrest. Heoce, for 
most male youths (the 75 percent who reported do previous arrest) the program appeared 
to have a negligible effect, as was the case for feoule youths. 

The findings for out-of-school youths In this study are not inconsistent with those from 
the two existing experimental studies of employment and training programs for out-of- 
school youths.'^ The first, the youth component of the National Supported Work 
Demonstration, evaluated an intensive work experience program (Manpower Demonstra- 
tion Research Corporation, 1980); and the second, JOBSTART, evaluated intensive 
education, en^Ioymeat, and training services provided throuj^ JTPA'iCave and Doolittle, 
1991). The Supported Work study found negligible post-program bnpacts on the earnings 
of youth participants, most of whom were male. JOBSTART found negligible short-term 
impacu for female youths and large negative short-term impacts for male youths, 
mirroring the findings of the preseot study. 

Both JOBSTART and the youth component of Supported Work targeted seriously 
disadvantaged youths, who make up only a portion of the out-of-school youth population 
targeted by JTPA Title B-A programs. And Supported Work provided far more intensive 
services than a/e typically available from JTPA. Thus, the three studies of employment 
and training programs for youths focus on different target groups and program scrvices- 

Ncvcrthdos. none of these studies Indicattt diat programsjexamined^^ 
to improve the eaninp prospects of disadvantaged youths; and two of the tfifee 'ttildiet 
found that the programs actually reduced the earnings of malt youths; it Tei^Tn ffiraiort 
term. The experimeoul findinp to date tre ftierefore cause fbr concent. 



Implications of the Findings 

Tht National JTPA Study b based on an examination of 16 study sites, which are not a 
probability sample of all JTPA service delivery areas isnd which, despite their diversity, 
may not be representative of the nation. Nevertheless, to the extent that the fmdings in 
this report apply to other k>ca]ities, they have important policy implications. 

The study has shown that JTPA TiUe B-A U helping to raise the eaminp of many of 
its participaau, especially adultt, but It has also idendfied several groups for whom tSoe 
program Is having no «ff«t or cveo advtfse effeco^ " In paitlaUar, theTltle B-A PfO^^JJ^ 

fiadw ttoteM pny^ liok icltfUc iafomilMa 

wma^amMftamxkim^^^mtl tethercvkwia BcUey, HoQiiler. «d PtfutDoipM 
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ttudied ^ed to raise the average earnings of out-of-school youths in general, and they 
'reduced the average eaminga of male outK>f>«cbool youths who rqwited having been 
arrested between their sixteenth birthday and random assignmeot 

But aldiough this analysis has Identified groups sot being adequately served by the 
program, we cannoc w these findings to prescribe ways to serve them better. The study 
was designed to observe only the impacts of JTPA as it was opeaicd during the study 
period, not alternative ways of serving the same population. 

Finding ways to improve program perfonnance for those groups negligibly or 
adversely affected by the current program wDl require experimentation with a range of 
alternative service strat^es for those groups and ritoroia evaluation qf their impacts. 
We cannot overemphasize the importance of rigorous evaluation of new approaches to 
serving these groups. Experience has demonstrated that simply trying out alternative 
program strategies without rigorous evaluation is not enough. As a National Research 
Council report concluded in reviewing some 400 reports on a wide range of youth 
employment and training demonstrations, "Decile the magnitude of the resources 
oiteatlbly devoted to the objectives of research and detxvnstratioii, there is little reliable 
information on the effeoivcDess of the programs in solving youth employment problems'* 
. (Betsey, Hollister, and Papageorgtou. 1985). To address this deficiency, the authors 
recommended greater reliance on field experiments with random assignment. 

Indeed, the reason it is difficult to draw conclusions from studies that do not use 
random assignment is dear from our fmdings on the control groups in this study. The 
patterns of control group earnings over the IS-month follow-up period demonstrate that 
even without access to JTPA both adulu and youths would have experienced a growth in 
earnings, and their earnings would have varied substantially across the three service 
strategics. In other words, if one looks only at the post-program earnings and employment 
of program participants, one can easily mistake patterns of outcomes that would have 
occurred anyway for impacts of the program. 

Finally, although the findings presented here clearly reveal a need for some program 
changes, the full findinp of the National HTA Study have not been obuined. Our 
forthcoming final report will extend the analysis in several ways. First, we will estimate 
program impacts on eaminp, employment* and educational attaiiunent over a longer 
follow-up period. Growth or decline in the impacts during the period beyond 18 months 
could materially alter the difTcrcncea in estimated irt4>acts among target groups, service 
strategy subgrtxips. and other key subgroups that w*e have observed thus far. Second, wc 
will also include estimaied impacu on the receipt of AFDC and food stamp benefits. Third, 
and most important, we will compare the Impacts and cosu of JTPA Title 11- A and its three 
service strategies, to determine the cpst-efTcctiveoeu of the progrji^ at the 16 study sites. 
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Mrs. Thurman [presiding]. Thank you, Mr. Orr. We have a series 
of questions, and I will start with Mr. Crawford. 

You recommend that the Labor Department take a more active 
role in overseeing the JTPA program and in using its expanded 
data system to manage the program. Can you give us some exam- 
ples of what DOL should be doing? 

Mr. Crawford. In taking a look at that more active role for the 
Department, I think part of what the Department should be doing 
is in the area of regulation — getting the regulations written, get- 
ting those regulations out to the service delivery areas and to the 
States, to clarify issues, to help them. 

I think also part of the issue is within the area of oversight. As 
I had mentioned in my statement, the lack of sufficient oversight 
in some cases has allowed SDA's to overcharge administrative 
costs, to have excessive OJT periods, to award contracts payments 
without having them fully documented. 

In this oversight role, I think that the Department needs to work 
very carefully with the States in coordinating the oversight and 
f(upport to the local SDA's. I think that the data system will afford 
the Department, the States, and the SDA's to do some of the things 
that Larry was just suggesting in terms of recognizing that we can- 
not wait another 2 or 3 years for results but, with the improved 
data system, we can begin to look at what is happening to some 
of the segments of the population that are having a problem and 
try to figure out what kinds of interim adjustments can be made. 

It can also serve as an opportunity for the Department, working 
with the States again, to identify, let's say, SDA's that may be hav- 
ing problems, maybe in more of a proactive fashion, to provide 
technical assistance and to maybe even disseminate some of the 
good ideas that are being implemented at the State and local level. 

Mrs. Thurman. Mr. Crawford, do you believe that DOL has 
enough resources now to oversee the JTPA program? I find that a 
difficult question to ask after hearing about 65 programs and the 
amount of money spent. 

Mr. Crawford. Concerning the issue of funding for the Depart- 
ment, we have not looked at that so, to respond in terms of wheth- 
er the Department has the money, the resources to do that, I think 
would be inappropriate for us. We would prefer to defer that to the 
Department to respond to. 

Mrs. Thurman. The ABT study draws disturbing conclusions 
about job training for youth. Have your studies shown the same 
conclusions? 

Mr. Crawford. Yes, we have found similar instances, and I will 
have Mr. Nilsen just give a couple of examples. 

Mr. Nilsen. As was noted in our testimony, we were not sur- 
prised by the results of the ABT study. We found, both for adults 
and youth, less-intensive services for people we called less job 
ready, people who you would think would get more intensive serv- 
ices — people without recent work histories, people who were drop- 
outs — and this applied to both youth and adults as well, 

Mrs. Thurman. Mr. Machtley. 

Mr. Machtley. I have just a couple of questions. 

One of the things that I think concerns me about any Federal 
program that is established is that we don't seem to have bench- 
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marks in which to measure it as it is proceeding along. We seem 
to bootstrap ourself into some assessment of its success based on 
what we find in the conclusion studies. 

Are there currently adequate objective benchmarks in the JTPA 
program so that a year from now well come back here and we can 
measure whether or not, on a cost-effective basis, it was worth in- 
vesting $1.8 billion in order to help the targeted population? 

Vm specifically concerned because, when I read the findings, for 
people who were geared toward the wage impact or the economic 
impact or the educational impact, it doesn't look like they justify 
the cost. It's a great concern when you find that, because the 
participatory employment figure was 70 percent when you went 
back, that that was really not a true indication of how many people 
were successful in employment. 

What is the benchmark that has been established, it any and, if 
not, why not? 

Mr. Gerald Peterson. Ill take a quick shot at it. Even the new 
reporting system that is being developed — not the one that was in 
place when we looked at it, but the new reporting system — still will 
not collect data that we feel is very important and the Congress 
have felt is very important. 

For instance, the reduction in welfare — that figure still will not 
be collected. So even the new reporting S3^stem that ETA will be 
talking to you about later in the morning will not be collecting data 
that important. 

So, in terms of a cost effectiveness measurement of this orogram, 
that is not in the design format at this point in time. Therefore, 
you are not going to be able to make a cost effectiveness determina- 
tion. 

Mr. Machtley. Maybe I've made it too complicated. Has the 
JTPA said: "A year from now, here are the criteria on which you 
measure our success"? Have they benchmarked themselves objec- 
tively so that we can assess how successful they are? As you are 
sajnng, collecting data after they have been in existence is not a 
very good way of determining success, it seems to me. You have to 
benchmark. 

Mr. Crawford. I think perhaps maybe I can help. The perform- 
ance measure standards that JTPA has in place provides a meas- 
ure of the numbers of people placed and wages. Their improve- 
ments in their data reporting will be good. 

Part of what we were arguing for is a more systematic approach 
to gathering data with an understanding of figuring out what 
works and figuring out what we would need to do to get there, and 
we think that strategy would include more in the way of measuring 
impact by gathering^aseline data and then making adjustments in 
the kinds of information that JTPA routinely collects. 

So I think it is more of a position or a philosophy in tem.s of 
knowing where you want to go and being able to measure how well 
you are doing and then being able to then make necessary adjust- 
ments. It's not clear that is where we are headed in a systematic 
fashion, 

Mr, Machtijcy, Is there any problem in establishing — whether 
we all agree or not agree — but establishing somehow a benchmark? 
In other words, we say: "Look, we want tne earning add-on value 
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to be increased by 5 percent for the people who participate.** I see 
that some of the gi aduation or GED or diploma rates have doubled. 

If you have 5 percent and it makes 10 percent, that is not a great 
record, but if you say, "we want it to be 30 percent of all those who 
participate" or "we want it to be 50 percent, whatever the number, 
at least a year from now we can say, "yes, we were successful in 
meeting the goals of the Job Training Partnership Act" or, "we 
weren't successful and therefore we ought to go back and see why 
we did not reach the goals which the administrators of the program 
set themselves." 

I get the sense that we are ju?*^. wandering around spending $1.8 
billion and some day we may do a study and find out what works, 
but probably we will just say, "boy, that didn't work." 

Mr. Orr. Sir, if I could respond to that? The program does have 
well-defined performance standards and, as Mr. Crawford indi- 
cated, they are intended to ensure a certain level of efficiency in 
the program. For example, standards are set on the number of par- 
ticipants who are placed in jobs. If the program doesn't do that, it 
is not functioning properly. 

Unfortunately, that kind of standard doesn't do the kind of thing 
that you were alluding to a minute ago — ensuring that the program 
increases the employment and earnings of the participants as com- 
pared to what they would have achieved if they hadn't gone 
through the program. After all, many people who become unem- 
ployed do not go to JTPA, and still find jobs and become employed 
again and have reasonable earnings. 

The only way to measure that kind of value added, at least the 
only way that v/e know, is to do the kind of random assignment 
control group impact evaluation that we have done and, unfortu- 
nately, one cannot do that in every SDA in the country. It's a big, 
complex undertaking. One can only do it periodically. It takes a lot 
of time, because you then have to follow these people for several 
years to find out what the longer term impacts were. 

I would like to be able to give you a neater, cleaner, simpler pre- 
scription for making the program work, but that is my view of the 
problem of doing what you are suggesting. 

I think the current performance standards that focus on effi- 
ciency may be about the best one we can do in the situation, along 
with periodic attempts to measure the value-added impacts. 

Mr. Gerald Peterson. Except the law mandated sort of a *TDe- 
fore and after" kind of a look at a person. That is to say, Congress 
said that this is an investment in human capital and the return 
on investment should be measured in terms of added income or de- 
crease in dependency on welfare and, 10 years later, even that sim- 
ple kind of measurement has not been put in place. 

They are not measuring the before and after. They are not meas- 
uring the impact on welfare. So I think it is time that, these two 
factors at least, be measured. This is something that is do-able, 

Mr. Machtley. Well, I think that there are measurements. I just 
don't believe efficiency is the only way to measure a pro-am. It 
may be more efficient to give everyone $900, but I don t think 
that's the goal of the program. 

So I think we have to figure out a way to have these specific 
whatever they are — and the people in the JTPA ought to be able 
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to come up with their own measurement tools — whether it is how 
many people have gotten off welfare, how many people have im- 
proved their education, and have a goal in advance, and then see 
how we have reached that goal. So I hope that they are going to 
work toward it 

Mr. Peterson [presiding]. To follow up on that, in your testi- 
mony you were talking about that determining a total investment 
for each participant was impossible. You just stated now that they 
cannot tell how many people that were on welfare and are off, and 
so forth. 

I went out and looked at the JTPA program in my district and, 
in that particular program, they have every bit of this information. 
They know every single day, every piece of information you could 
ever want about these people. It is all there. 

Mr. Gerald Peterson. Mr. Chairman, oftentimes you will find 
that done even on a statewide basis, but it is not collected and ana- 
lyzed from a national perspective. 

Mr. Peterson. Why not? 

Mr. Gerald Peterson. I think that question needs to be directed 
to ETA. They operate the program and they have said repeatedly 
that they just can't get hold of the information on reductions in 
welfare. Why that is, I think that they are in a better position to 
address. 

Mr. Peterson. So you will admit, then, that the information is 
there? 

Mr. Gerald Peterson. Oftentimes we find the information 
available. 

Mr. Peterson. Do you have any idea of how often it is there and 
how often it isn't? Is it there in 60 percent of the programs, or do 
you have any kind of sense of that? 

Mr. Gerald Peterson. I think actually it is rather an excep- 
tional case when it isn't available. The individual programs will 
most often — certainly over half the time — ^have that kind of data 
available, and sometimes being analyzed at that level. 

The problem with it is that it is not being collected on a national 
level, and you can't make conclusions with any degree of certainty. 

Mr. Peterson. One of the reasons for decentralizing this was to 
try to give the States more flexibility, more control. Shouldn't they 
be collecting this stuff on a State-by-State basis if they are the ones 
that are, in effect, managing these SDA's? 

Mr. Gei^ld Peterson. I think ideally the partnership/, that is to 
say the Federal-State-local partnership, should each have that data 
available to them so that each level can make some judgiTients and 
fine tune the program. That would also involve the Congress. The 
Congress ought to have that kind of data available to them. 

Mr. Peterson. Is this data getting up to the State level? Do they 
have this information? 

Mr. Gerald Petf:rson. It's a mixed bag, sir. 

Mr. Peterson. Some States do and some do not? 

Mr. Gerald Peterson. Most often, it is not getting to the State 
level. Most often it is not. 

Mr. Pkterson. So that is where it is breaking down? 
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Mr. Gerald Peterson. I think where it is breaking down is that 
there is not a strategy for the collection of that data. There is not 
a partnership. 

Mr. Peterson. So the problem goes back up to the ETA? 

Mr. Gerald Peterson. It goes back up to the Federal level. 

Mr. Peterson. Do you agree with this, what we are just talking 
about here, Mr. Nilsen or Mr. Crawford? 

Mr. Crawford. I think overall we would agree that one of the 
disadvantages to the hands-off approach, is that there is an un- 
evenness with the States and at the SDA level in terms of what 
you can find, how active — certain States are more active and have 
better oversight. Certain SDA's are more active, creative. But 
again, it is the unevenness that exists. 

Mr. Peterson. One other thing. When you went out and looked, 
what kind of a sample did you look at? 

Mr. Gerald Peterson. In our audit, sir, we went to, I think 35 
different SDA's. 

Mr. Peterson. Were they scattered all over the country? 

Mr. Gerald Peterson. They were scattered all over and were 
randomly selected. Our report, unlike the ABT report, concentrates 
strongly on the inner city — the urban area. I think, for the most 
part, the ABT study has missed the urban area entirely. 

Mr. Orr. That is not entirely true. 

Mr, Gerald Peterson. A major urban area? Tm not sure. But, 
at any rate, as I remember, they didn't hit a major urban area. 

We started our sample with 1,750 participants — 50 from each of 
the SDA's. That was what we looked at. 

Mr. Peterson. Does it say which 35 this is in your report? 

Mr. Gerald Petei^on. Yes. The SDAs are in the report. 

Mr. Peterson. OKL 

Mr. Gerald Peterson. Or, if they are not in the report, I will 
make them available. I think they are in the report. 
Mr. Peterson. I guess I would be interested in knowing that. 
Mr. Masten. Yes, they are in the report. 

Mr. Peterson. I obviously haven't read it in that detail. Were 
you going to say something? 

Mr. Crawford. I was just going to mention, just highlight some 
of the coverages that we have had, in terms of the SDA's. Mr. 
Medvetz. 

Mr. Medvetz. Yes. We have carried out some — well, one exten- 
sive study, in which we visited 63 SDA's, and we agree with Mr. 
Peterson that the recordkeeping at the SDA level was very incon- 
sistent. Some of the SDA's had very accurate and complete records 
and others we had to reconstruct everything that we did. 

Mr. Peterson. You had to reconstruct it? 

Mr. Medv1':tz. Yes. By digging through participant files and 
other work. 

Mr. Peterson. What kind of records do they have, just financial 
records? 

Mr. Medvetz. The problem was the consistency. 
Mr. Peterson. And again, because the ETA has not told people 
how to put this together? Is that what it is? 
Mr. Medvetz. Yes. 
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Mr. Peterson. There is no standardized format? Everybody has 
kind of developed this on their own? 
Mr. Medvetz. Yes. 

Mr. Peterson. Does anybody know why that is? 

Mr. Gerald Peterson. Sir, I would like to just say that I do 
think the 1992 amendments are going to significantly impact that. 
I believe GAO would agree that, oetween us, we got 90 percent of 
what we asked to be included in the 1992 amendments. 

Mr. Peterson. How long is it going to take for those to take hold 
so we know whether we have this under control or not? 

Mr. Gerald Peterson. Now, you're asking the tough questions. 
[Laughter.] 

I think they are to be implemented as of July of this year, and 
my guess is that because of the detail — there is a sigrdficant 
change, a very significant change — I would guess it is going to take 
about 12 months for them to be fully integrated into the various 
SDA systems. 

Mr. Peterson. Mr. Rush, if you want to ask questions, we will 
recognize you now. 
Mr. Rush. I have to go now. 

Mr. Peterson. Well, we appreciate you stopping by. 
Mr. Rush. Thank you. 

Mr. Peterson. So it is going to be implemented July 1, and it 
is going to take 12 months. That will be July 1, 1994. And it will 
take 6 months for you to figure out what happened. So we are look- 
ing at January 1, 1995, before we know? 

Mr. Gerald Peterson. That is probably a good date. 

Mr. Peterson. Will we know anything before that? 

Mr. Gerald Peterson. Well, we are going to know something. 
We are going to be down in those SDA's at some level. However, 
the impact of the changes, I think, you are not going to know a 
great deal about until then. Some of the SDA's, of course, will move 
much faster than others. 

Some of them, for all intents and purposes, I think ETA would 
tell you and my staff would tell you, have implemented them now. 
Again, it is a very inconsistent bag out there. 

I think, in fairness to the system, I don't think you could meas- 
ure it systemwide until about 1995. 

Mr. Peterson. These States, every State has some kind of orga- 
nization that controls the SDA's in their State; is that correct? 

Mr. Gerald Peterson. That is correct. 

Mr. Pt:TEltSON. What are they doing? Why aren't they weighing 
in on this? If they wanted this responsibility, why aren't they help- 
ing to — in all cases, helping to implement it? 

Mr. Gerald Peterson. I think it is inconsistent again. But, for 
the most part — and it is bad, sometimes, to generalize — but, for the 
most part, I think the States did not step in as was envisioned in 
1982. I think we envisioned that the States would step in and take 
over the role ETA had played in the past. I think, for the most 
part, that simply did not happen. 

ETA reduced their staff, as you know, very considerably. And I, 
for one, would not be bashful to tell you that I do not think ETA 
has the resources to carry out the oversight 

Mr. Peterson. Right now? 
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Mr. Gerald Peterson [continuing]. Right now, I don't think 
they have it. I think that they are spread very thin and are going 
to need some help. 

Mr. Peterson. Do the States have the resources? 

Mr. Gerald Peterson. Again, the States did not build up the re- 
source that was expected to take place. 

Mr. Petepson. Should we undo that? Should we take the States 
out of this? 

Mr, Gerald Peterson. I think that is a question for someone be- 
sides me. 

Mr. Peterson. You don't have an opinion? 

Mr. Gerald Peterson. I have an opinion. I think the States 
should be in it. I think it was hopeful thinking, however, that they 
would react to it rapidly and provide the kind of oversight that 
ETA had provided. It just did not happen. At least, it did not hap- 
pen uniformly. 

That vacuum has been there for the past 10 years, and I am not 
sure that we can correct it without giving the ETA some resources 
to provide a more active Federal role. 

Mrs. Tj^tjrman. Mr. Chairman. 

Mr. Peterson. Mrs. Thurman. 

Mrs. Thurman. Will you vield for a second? 

Mr. Peterson. Yes. Go ahead. 

Mrs. Thurman. One of the components that I see missing here 
m evaluating all of this — and we do a lot of percentages, we do a 
lot of numbers — at the same time, between the 1982 to 1992, there 
was also a tremendous job loss around the country. Economics 
played into this as far as where and who could be placed, how they 
could be placed. 

Is that a part of this report? I think that is a component, espe- 
cially when I think of Florida, where unemployment rose dramati- 
cally. It's hard to place somebody if you do not have the jobs to 
place them in to go to or to bring them to a higher level job. 

We saw businesses failing during this time, so there was again 
no placement, and there certainly was no room for improvement for 
wages. 

Can any of you respond to how that fact plays into these particu- 
lar programs? 

Mr. Orr. I could respond with respect to our own study. You are 
absolutely right, that the state of the local labor market may have 
a strong influence on what the program can do with a particular 
individual. 

In our study, we were able to at least take that into account to 
the extent that we were comparing the JTPA participants with a 
set of control group members who faced the same labor market con- 
ditions. So the question we were asking was, even in a bad labor 
market, was the program able to help its participants do better 
than they would have without the program? The study sites also 
represented a fairly wide range of unemployment levels in the local 
labor market. This allowed us to look at the variation in program 
effectiveness across sites with different unemployment levels. Now. 
unfortunately, when you ^et down to that level, we had fairly small 
samples in each site, so it was not a terribly refined test. We did 
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not find any significant difference in the way the program fimc- 
tioned in low unemployment sites versus hi^h unemployment sites. 

In other words, we were not finding significantly oetter impacts 
in the low unemployment sites than we found in the high unem- 
ployment sites. 

Mr. Peterson. Besides that, we were supposed to have this big 
economic boom during that time. We created how many millions of 
jobs? 

Mrs. Thurman. I just thought I would bring that up just because 
of that particular circumstance. [Laughter.] 

Mr. Gerald Peterson. I think maybe the bimer problem is the 
fact that we have very little money going to skill training. I think 
the most alarming part of our report is that when you look at the 
money that actually goes toward enhancing a person's skill level, 
it is only around $900 or $1,000. So, regardless of what your job 
market is, you are not going to buy very much enhanced SKill level 
with that kind of money. 

Remember that we reduced drastically the amount of money 
going for training purposes when we went from CETA to JTPA. We 
added a level of administration — the State — so that the administra- 
tive costs of the program went up. The portion of money that actu- 
ally goes to the added value of the person, the skill level of the per- 
son, has eroded. 

You can find some great successes in the program, but most of 
those successes that you find and you say, "Gee, that is what the 
program really should do," you are talking about an expenditure of 
maybe $10,000. You are not talking about $1,000 or $900 any 
more. Currently, you are not buying a whole lot of training witn 
this program. 

Mr. Peterson. You iust said again that the States created more 
management costs and you are saying we did not get anything out 
of that. So why should we keep the States in this: If they are not 
going to help us do part of this job, aren't they getting in the way? 

Mr. Gerald Peterson. I guess because you nave to think that 
this is a State problem as well as a city, local, as well as a Federal 
problem. I thinlc various levels of government certainly need to be 
concerned about this problem. 

Mr. Peterson. Are the States putting anything of any signifi- 
cance into this beyond funding administrative positions? 

Mr. Gerald Peterson. Again, ETA may be in a better position 
to answer that. 

Mr. Peterson. I think maybe some States are doing some things, 
probably. 

Mr. (jERALD Peterson. They may be. They may be. 

Mr. Peterson. But I suppose it's all over the map. Does the GAO 
agree that the States have not really weighed in and provided 
much management and oversight? Do you agree with that assess- 
ment? 

Mr. Crawford. Generally, I think we would. I think that, again, 
the Department has not provided the leadership, has not called 
upon the States, in many instances, to do this. I think, as part of 
that issue of weighing what to do, the States do, to some degree, 
vary and it's uneven in the extent to which they are involved in 
oversight and monitoring. 
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If you eliminate the States, if that is one of the considerations, 
then the Question becomes, would you have to perhaps considerably 
enhance the Federal level to be able to pick up the slack and to 
also do those additional things that you feel that the States should 
be doing. 

I think the States, if they are involved, should have a value- 
added role. I think anyone involved should have a value-added role. 

Mr. Peterson. Does the Department of Labor have enough re- 
sources to manage this and oversee this? 

Mr. Crawford. We did not look at that, at the resource level 
within the Department and, therefore, I am really not in a position 
to comment on that. I think if you are proposing to give them sub- 
stantially enhanced responsibilities, then the resource issue may be 
something that you very seriously have to look at. 

Mr. Peterson. In the 1992 amendments— and I wasn't that in- 
volved m those and am probably not up to speed as much as I 
should be— thev were, I gather, not really given any more resources 
to implement those? 

Mr. Crawford. I don't think so. 

Mr. Gerald Peterson. Not to the best of my knowledge. They 
certainly are given a bigger role. 

Mr. Peterson. Right. But they were not given any resources. 

Mr. Gerald Peterson. Again, ETA can better address that. I am 
sure they will be happy to diiscuss that. But I know that they have 
an enhanced role. 

Mr. Peterson. I have some other questions here, but maybe we 
ought to just submit those to you in writing and we can move along 
here, so we don't run out of time. 

I appreciate your being with us. Your testimony and your an- 
swers to the questions were useful, and we will probably continue 
to focus in on this as we move along here. Thank you all very 
much. 

I call the next panel. We have William Struever, who is a part- 
ner in Struever Brothers, Eccles & Rouse in Baltimore, and a mem- 
ber of the Maryland State Governor's Investment Board; Patricia 
Irving, president and CEO of the Philadelphia PIC; and John Zel- 
ler, executive director of the Montgomery County PIC and Jon A. 
Gerson, director of economic development for Montgomery County. 
If you would all come up. 

As is the custom, we swear in all of our witnesses, if you don't 
mind. So, please stand. 

[Witnesses sworn.] 

Mr. Peterson. Before we start, we were also going to have Mr. 
Larry Buboltz, who runs Rural Minnesota SEP in my district be 
with us, but he came down with some kind of a head cold or what- 
ever, and they did not want him to fly. He does have some testi- 
mony, which I would like to make part of the record. 

One of the reasons we wanted him to be here was that he has 
one of the outfits in the country that does not operate underneath 
the SDA. They operate directly, for whatever reason and, in my 
opinion, do a pretty good job. iSo we will make his testimony and 
the information available, without objection. 

[The prepared statement of Mr. Buboltz may be found in the ap- 
pendix.) 



ERIC 



93 



96 



Mr. Peterson. We will start off with Mr. Struever. Welcome to 
the committee, and we look forward to hearing your testimony, 

STATEMENT OF WILLIAM STRUEVER, PRESIDENT, STRUEVER 
BROTHERS, ECCLES & ROUSE, BALTIMORE, MD, AND MEM- 
BER, MARYLAND STATE GOVERNOR'S INVESTMENT BOARD 
Mr Struever. Thank you. A little background. I am a master 
electrician that turned builder that turned developer, and if the 
real estate marked in America doesn't get any better, I will be back 
being an electriciai. again. i i i. ^.v u 

My experience in the job training business goes back to the be- 
ginning of private industry councils in 1978 under CETA when I 
was appointed to the Baltimore PIC. I actually had a chance, m 
1982. to sit with the President in the oval office right before sign- 
ing tke JTPA legislation with a group of CETA trainees and talk- 
ing about the bill, so I got in on the beginning. 

It was a testimony to the bipartisan nature of this whole job 
training effort, which I think is absolutely critical. I m a diehard 
Democrat and, somehow, Reagan got me in there for the bill sign- 
ing, which is a wonderful thing— Democrats and Republicans work- 
ing together on this. , x 

I was chair of the Baltimore PIC. I remam active on the btate 
coordinating council. We call it our Governor's work force invest- 
ment board. Before that, I was chair of the education and then 
youth policy committees. I am on the board of the National Associa- 
tion of Private Industry Councils and am currently chair of the 
U.S. Basic Skills Corp., which is a big literacy nonprofit foundation 
doing work around the country. . v . 

I mention this because of the importance of coming to the issue 
of how well JTPA is doing from a broad perspective, both in terms 
of the kind of things it does and historically looking back, as we 
have been in this business for a long time now. It is always, as a 
businessperson, one of my great frustrations with government is 
how we can build on experience instead of constantly, every 4 
years throwing things out because it's Democrat or Republican and 
starting over again, instead of trying to build on that experience 
and do better. _ . , 

I will try, quickly, to touch on the questions you have asked 
about the important features of JTPA and the role of PIC s and 
State councils and some of the successes and some of tho problems 
we have had, and who we try to serve, and then tiy to end up on 
some key issues looking forward. 

On the strengths of JTPA, No. 1 is the partnership. This oppor- 
tunity to bring business and labor and government together in a 
real way is tremendously important. 

A second key part of JTPA is the effort to work together in an 
integrated way across agency and program boundaries so you don t 
care whether it is this thing or that thing, but you care about what 
comes out. Ultimately, the third feature being the performance- 
based outcome driven nature of JTPA is really the most important 
part: How can vou get these folks so they can be self-suflicient with 
good-quality jobs and take care of their own problems? 

Fourth, when you are talking about oversight, a big strength ot 
JTPA is it is a locally managed and relatively flexible program 



97 



which, given the treinendous diversity — vou are talking about the 
economy and what effect it has on tne labor market, the kind of 
jobs that are available and the kind of resources that are available 
in different communities — to be responsive to that and effective 
and have good programs, you really have to have locally based pro- 
grams that can be flexible and work around local conditions. 

The role of PIC and the role of business: Coming from the busi- 
ness world, I personally think it is absolutely wonderful that we 
have created this opportunity for business to take a leadership role 
dealing with a top economic issue before the country. We know 
where the job market is and where it is going as well as anybody. 
It is a tough thing to keep track of. 

In many senses, business is the customer, the people that need 
to help put unemployed folks to work. The role of PIC's is an inter- 
agency policy board. The wonderful thing in our PIC is that we 
have no patience for turf, as to **This is in the Welfare Department" 
or "This is over in Voc. Ed." or "This is over in Education." We 
don't care. We all sit around the table and work together, and that 
is how we see our PIC working. 

We are outcome driven. We ask tough questions on our PIC. Five 



schools. So we forged a major effort, in partnership with the school 
system. Now, we have a real concern about what is happening with 
tne out-of-school youth and we are really making a big push on 
young male dropouts. 

That is the type of policy direction that comes out of the PIC's 
and the partnership and the businesses knowing what is going on, 
and the accountability, which is a major part of what PIC's are 
about. PIC's are also advocates — advocates for investing in a 
proactive way to solve these problems. 

We have taken the PIC, our PIC, and expanded in taking a larg- 
er role in work force investment issues. There are many PIC>s 
across the country doing this. 

In terms of our State council, in our State we are blessed ^yith 
very strong leadership from our Governor. He has his key cabinet 
people on our council and on our executive committee. We sit down 
together with the State school superintendent, the head of eco- 
nomic development, the head of job training, and knock heads and 
try to work things out, so a real effort to coordinate. Since so much 
funding and program regulations come from the State level. State 
coordination is critical. 

Our State council also plays a key role in terms of capacity build- 
ing, working with the 12 PIC's in our State in terms of helping 
them get better and smarter about how to run effective programs. 
The State council has been a very important tool in terms of 
leveraging State funding to work with JTPA. Our PIC gets only 
about naif of our funding from JTPA and the rest comes from all 
kinds of different sources, including State moneys. 

Our State council is also leading the way nationally in terms of 
this concept of the broader role in work force investment programs, 
which I am excited about and I think is the future. 

A couple of successful programs, then I will talk about some 
headaches we have. 
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Project Independence, which is our JOBS/welfare emoloynient 
program. We had a jump start, because we had a State welfare em- 
ployment program called investment in job opportiaiities a couple 
years ahead of JOBS and we gave PiC's the lead responsibility, to 
convene on the local level and do planning because, again, the is- 
sues are different. 

In some parts of the State the biggest issue is there are no cars, 
no transportation. How do you get people to work? In Baltimore 
Citv, the issue is that nobody can read. 

So each local PIC was in charge of putting the SDA, the welfare 
department, the education department together, and coming up 
with our own plan about how to run a welfare employment pro- 
gram that looks at support services — health, child care, and trans- 
portation — what kind of education and training support we need, 
and where the jobs are, and job placement. 

A second successful program model is in dropout prevention. As 
I mentioned before, we are tremendously concerned with our 50 

Eercent dropout rate that we have in Baltimore City and not as 
ad, but also a serious problem elsewhere around the State. 
So we started, 4 years ago now, a program that focused on eighth 
graders coming into high school that were doomed to failure. These 
are kids that were two grade levels behind. Statistically, over 90 
percent would not graduate without somebody getting there, ag- 
gressively intervening and helping the kids get on the straight and 
narrow. 

That is what this program is. It is a vear-round program. Inten- 
sive summer, in school, out of school. We have counselors for every 
25 kids, that are those kids' advocates in making sure they show 
up to school and working with their families. A wonderful program. 

What doesn't work? I think — constantly looking at your outcome- 
based programs and talking about all these statistics and stuff that 
the IG and everybody was talking about a minute ago — ^it really 
comes down to, when you are sitting down in your rIC, talking 
with the SDA director and the different program operators, you 
know, ''What is going on here," there are a lot of measures out 
there as to how tnings are going, and we do ask tough questions. 

A good example of this, and where we see things not working, 
and we are constantly trying to make things better. When we start- 
ed Maryland's Tomorrow Dropout Prevention Program, after the 
first IV2 years we had our results in. Academics for the ninth-grad- 
ers was a big, big problem. 

We had tnis wonderful summer program with outward bound 
and work experience. And we said, "Wait a minute. We got to get 
going on academics so when they come in the ninth grade they 
real^ have a running start instead of being behind." So we greatly 
reinforced our academic enrichment in Maryland's Tomorrow Pro- 
p*am and improved the program results. We are constantly tinker- 
ing, askine tough questions, making it belw3r. 

I am delighted to see that the President's proposal for summer 
challenge talks about a third of the new money being available for 
academic enrichment. We are great believers that summer pro- 
grams should have a very strong foundation in skill training and 
basic skills, and helping kids get through school, and not just work 
experience. 
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Other things that have happened. We have had a real tough time 
in our literacy programs in terms of coordinating across all the dif- 
ferent things going on. That is something we are still working on, 
with adult basic education and all these different little funding 
sources kicking around out there, how we can also convene literacy 
teams at the local level. In Baltimore City we have a great program 
going that way, but elsewhere in the State, a problem. The job 
service has been a big difficulty in years past in terms of trying to 
get them on the team. 

So those are the problems that we continue to struggle with, 
with our programs. 

In terms of who we serve in Baltimore, Baltimore, like many 
other large cities, has enormous problems with desperately poor 
people and lack of jobs. Fifty-one percent of the people in our pro- 
grams, JTPA programs, are welfare recipients. Ninety percent are 
minority. A third are dropouts, and that is even though we have 



As I mentioned in terms of people served, one of our big pushes 
now — and I think the JTPA amendments are pushing in the right 
way — is out-of-school youth, because we are losing 50 percent of the 
kids entering high school who are not coming out the oack end. We 
have a big push with young male dropouts that we are just starting 
now. 

Fifty-five percent of the young African American men in Balti- 
more that are 18 to 35 are either awaiting trial, in prison, or on 
parole. An enormous problem that is literally tearing out the con- 
fidence and spirit of Baltimore. We have a great city but, unless 
we do something about helping these kids get into society in a pro- 
ductive way, we are in big trouble. 

So we have an action plan that we are putting together. The 
State is working on this and the Baltimore PIC is working on this, 
to do a residential-based program for first-time, nonviolent offend- 
ers, working with the Job Corps as a possible satellite demonstra- 
tion project. 

We want to do a skills academy, a nontraditional approach to 
skills training outside of the traditional school environment, a very 
disciplined kind of base. We want to do community hubs where we 
can put the same kind of comprehensive efforts that we have done 
with welfare recipients, with women, who have different kinds of 
barriers and problems. We need to do that with the young men in 
terms of how we can speak the language and get them involved 
with training and going someplace. 

Another population served that we are starting to work on is cur- 
rent workers, in upgrading skills and trying to create a high-per- 
formance work force, working with business on management and 
management training and upgrading. We have a program called 
partnership for work force Quality where we do 50-50 splitting of 
costs with business to do skill training with employees that are 
currently working. 

Does JTPA work? I think, if you have a locally managed pro- 
gram, 640 PIC's, in a flexible program, you are bound to have some 
that are great and some that are not so great. My personal feeling 
is that, on balance, you have some fabulous programs out there, 
and the trend is up in terms of doing better. 
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The important 5«sue is how Congress, how Washington, how the 
States can help reinforce and make local programs better. There is 
always room tor improvement in terms of the kind of things you 
were talking about, the constant hitting on the performance-based 
outcome measures — ^"Where are we weak; where do we have to im- 
prove that?" — and asking those tough questions. 

Like with the literacy program I mentioned, you still have pro- 
grams out there that are measured in quality by the hours of seat 
time. As a businessperson, I could care less how long somebody sits 
in a seat learning now to read. What I want to know is whether 
t} • learned to read. Do they have the skills to work and work at 
Oi- >f my job sites? That is what really counts in terms of outcome. 

^Another concern whether JTPA works is this kind of partnership 
with other agencies. There is a lot of progress in terms of this 
broader PIC role at the local level, and at the State level in terms 
of the work force investment system. 

One of the biggest culprits is Congress, and Washington, with all 
this stuff that comes out on vocational education or welfare, what- 
ever, constantly heading off in different directions. You have a 
work force system that is set up. You have a partnership set up 
with the private industry councils. Use it. Use it effectively. Make 
us accountable. Make us responsible. But give us the help and re- 
sources to do it. Don't make our problem worse by sending this 
stuff off in 50 directions. That's a big issue, 

A big issue for us in Baltimore and other big cities is a lack of 
jobs. You can talk all you want about placement rates. Jobs is the 
bottom line. That is the outcome they are all after, and quality jobs 
that pay a living wage for a family. 

Baltimore has lost 12 percent of its employment base in 2 years. 
Maybe the economy is recovering. Maybe not. But it sure as hell 
is not recovering in the city of Baltimore and it is not recovering 
in cities like us around the country. 

We need to do something to target economic incentives, to create 
jobs in cities, because the disparity between city and suburb-— it is 
happening in Baltimore, it is happening all across the country— is 
just growing enormous. Us folks on the PIC's and in JTPA cannot 
do our job unless there are jobs out there to be training and put- 
ting unemployed folks into. So we need your help with that. 

In the meantime, we need community service employment. If we 
don't have the private sector jobs available, let's put these folks to 
work with community service jobs. There are tons of e^od, produc- 
tive things that we can do in our community. We nave a tight 
budget, and if we could get the kind of public service fob support 
we used to get under the old CETA program, we could really go 
somewhere. 

The last issue is resources. When I started on the PIC in 1978, 
we had $115 million to work with on that PIC. I like to think we 
are good and efficient and effective. But we have a bigger problem, 
we have a higher unemployment rate, we have more long-term un- 
employment, we have less jobs to put people in — and we have $28 
million to work with now. 
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So you can talk all you want about effectiveness and efficiency 
xxrt need adequate resources to do the job. 
With those things, I hope you give a vote of confidence for the 
PIC system and do good things. Thanks. 
[The prepared statement of Mr. Struever follows:] 
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Testimony Of WilHam Slruever 

To The Government Operations Subcommittee on 
Employment, Housing and Aviation 

Good Morning, I am B\l\ Struever, tho President of Struover Bfothort, Eccle* and 
R.UBO, a doveJopmont comp^iny In Beimmora. For tn© past ten yocra I have been 
actively working with education, employment and training programa In both Bal- 
timore City and the State of f^flaryland. I am cunrentiy a member of the Baltimore 
City Private industry Councn and the Qovernor'a Work Force Investment Board. I 
was the PIC Chair for many years and cunrentiy chair the Youth Policy Commmee 
for the Sta^o Board. I am also active with NAPIC an J serve on their board. Even with 
all this experience, I don't consider myself an expert on the JTPA rules and 
regulations. But f have had a good deal of experience wHh JTPA and other 
government wortt forco dovolopment programs. 

I appreciate the opportunity to talk with you today about JTPA. I ^nt to address the 
issues outlined in your invitation letter, 

1 . Description Of The Role Of A PIC In JTPA Decisions and Funding 

The simple response to this Issue would be to recUe the party line and say that the 
PIC mskos all JTPA funding and program c'ectelons. Having been Involved with a 
PIC and the State Council for some lime, I know that this Is not accurate. PIC 
Involvement with funding and program decisions varies from PlC to PIC and can 
oven vary as the issues change. I think II Is fair to say that generafly thare are three 
ba ^ic categofles or types of roles that PiCs have assumed. The first la the role of 
■Board of Directors* vrtilch Is very similar to a corporate board of directors, A PlC 
that has adopted this role is generally very Independent, makes all of the major 
funding and programmatic declsk^ns and sets the overall policy and direction for 
teetotal program. In Maryland, this rdefsoften associated with PICs that have been 
Incorporated. Three or tour of the twelve PICs In Maryland have adopted this type 
of role. 

TTie second type of PIC role I see in Maryland is the PIC as a strong program and 
policy board. This role is somewhat different than that of the "Board of Directors-. 
Pica that have adopted this second type of rofe make maflor poncy and funding 
decisions in concert with the focal elected offidsis who appointed them. In other 
words, this second role represents s closer partnerah^ of government and busl^ 
noM. Tho majority of PiCs m Maryland have Uken this approach. For example, in 
Baltimore, Mayor Kurt L Schmoke has embraced tho work of the PIC and has 
elevated the poaHlon of the 8DA adminlstnitor to cabinet statue. 
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The lai^t typo of PIC rol9 - and I cm happy to report that R 1$ In th» minority In 
Maryl! .id - Is Vtxb PIC as an advisory group. At tho onsat of JTPA, ttila wa$ tha rota 
that tho majority of PICa In Maryland played. Over tir«ia thia typo of PIC has baan 
phddcd oirt aa local eiec^ad offlclala and ataff r altzad tha advantagoa that coma 

with sharing tha authority and resporwiblllty tor v/ork forca davartfpment with tha 
buGlnesa community. 

\Vhlla t}oth the first and the aacond roloa described can l>a affactlva, I beBava that 
the second role provides the best opportunity for effecttva PIC Input Before 1 move 
to the second Issue, I would like to ahara with you aome tdeaa aa to tha approprlgta 
role for a PiC In tha future. It may aurprlae you, but I ballave that none of these rolaa 
will bo effective In the future. WhHo the tirat two may be nne tor a PIC that Is simply 
focusing on JTPA, simply focusing on JTPA will not enable most communities to 
address the woilt force Investment lasues that confront our Nation. For the past 
yes: or so, tha State of Maryland has been developing and foatenng the Idea that 
the PIC needs to evolve Into a local work force Investment board: t group of 
business, government, education, and community laadera who conte together to 
addrosa the work force Issues that are of concern to the entire community. ThIa ts 
not to say the PIC becomes the control board for all resources, quite the contrary. 
This now PIC role la to act aa a f acintator to provide a focus for the appropriate local 
leadcia to work together to aolve laauea of mutual concern. In this roiOf JTPA Is 
simply one of many resource atrcams that fail under the overatght of the PiC. We 
are moving forward In Maryland with this concept. In Baltimore, we ara fortunate to 
have a progressive pic which attempts to funcuon in this role and is able to malritain 
the regular attendance of key piayera In the City including the Superfntendent of 
Education, the President of the local ccmmunUy college, the President of the local 
, AFL*C10 and many othera. Realizing the need to Identify the iob for the fuum and 
a means of customizing training for Jobs for those outside of the mainstream tabor 
force, our PIC Is facilitating a coltaboratlvo effort with a host of entitles Ibrm Industry, 
education, and government to address this challenge. Our Initial focue la on the 
health Induatry. This haa already led to the creation of a new Ufe Sclencea Training 
Center In partnership with our local coi^imunlty college, other PICs in Maryland are 
also expednnenting wtth aerving In almaar roles. I took the liberty of provfAng you 
with a descrtptk)n of the Idea which we oal the Action Planning GuideSnea For 
Local Integrated Work K)rce investment Systems'. It la attached to my written 
remarks. 



2. Examples Of Successful JTPA Programs 

Fkst, I need to tell you that I am the eternal optimist. Therefore, from my perspeotfve, 
there le no auch thing aa a teaa- than^ccosaful program, there are on^ prcgrame 
that aremoreaucceaafltlthanothen.lhaveaeenaomeJTPAefforta that dkhit work, 
but In almost every Inatance thta was more a reault of the people amrting the 
programs than In the overall program concept Therefore, i donl want to focue on 
the things that didnt work. I'd rather give you aome Inalghta ae to the Ihkige I have 
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Mfi thftt <So VfOtk. 

BMmof hat • long tradition of opmtlno tuccassfiit work force invettment 
proyrama on a very larQe ecate. Starting yeare ago wtth CETA and Marlon Plnee 
and rtgirt through today with Unda Harris and JTPA, Baltimore has had outatandlno 
government loaderahlp. If I wore to c^araoterizo the quainios 1 ee9 In the Baftlmore 
JTPA proflfama that cause them to he hotter than othor programs i come into 
contact wtth, those qualltSes would be teadorshlp and a Ijolsfic approach. In the City, 
the JTPA program Is used to forge real partnerehtps and to help coordinate many 
other efforts. Let me site some specmc examples: 

e Project Independence 

Project independence (PI), Is the Federal uOBS program In the City, it is a wonderful 
€}(amp!3 of using a team approach to hefp people on welfare break the cycle of 
dependency and move off welfare. The City PIC convened a welfare poncy hoard 
which brought together locally all the Important actors to assure the creation of an 
effective and responeWe deHvery system. I believe that It Is this type of coVaboratton 
that has resulted m one of the most ajgresslve welfare to work strategies In the 
country* A strategy that has broi ght together the local employment and tri infng, 
educar jn and soda! services delivery systems In a truly integrated fashion. By 
coup <ng JTPA funds with resources from numerous other federal, state and local 
f'inding streamSi we have teen able to provide a high support, long-term training 
and educatk)n program for people on welfare and It has produced good results. 

e The City That Reads 

The City That Reads Is an mmative to coordinate and organize adult meracy 
resources. lU goal Is to ell.nlnate Unteracy In Baltimore. Again the JTPA system In 
the City has been a central part of this effort. The SDA/PIC, woikfag hand In hand 
with the nonprofit agency created by the city to address the problem of adult 
Illiteracy set up special programs throughout the cfty to Jointly provide servlcei. 
Using tMe approach, both the JTPA system and the adult etfucatkm system are able 
to help more people and to provide a more comprehensive service delivery system. 

e The Futures Program (School Drop Otit Prevention) 

Sbrtngwftt^nA, JTPA 6% and 8tate funds, the PiC/$DA, wtth the hefp of the school 
svstem, hss built an extensive dropout prevention program fbr a number of the CRy 
high schools. This program Is administered by the PIC/SDA and operated In the 
echool by school empk>yeee. Baitknore, as la tnie ki many urban areae, has a 
aHinmcam school dropout problem . The FMres effort has started to have a po^^ 
Impact on tMe problem. I think that this effort le s great model of how jifa can be 
ueed effectively ass change agent in the achoole. 
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Thero aro many other good exainple) of JTPA efforts that wttrK. For exampia, the 
Battimora PiC and tt'a government partner, the Office of EmpToyment Devefopment 
were at the helm of the creation of the Baltimore Commonwealth. Thie provlcfea a 
contfnuum of acrvlcee for tn-school youth to prepare them for the future. Thee a 
cervices Include auch things as community acrvlce club9i college camps, 
v/orkshopo on cnreers In government anc] Industry, student lea :Urshlp development 
activities, launching entrepreneurs Into acton and other unique actwttlee. 

I think that It Is importa A to note that In the Cfty things work because wo don^ look 
at people a9 simply fitting Into a particular "program ator. We endeavor to assess 
each person and to work with that person to find out what they both want and need. 
Then, depending on the resources and networking available, we try to help that 
parson get what they need to achieve a laKK)r market coal that la aulted to them. 
This type of approach means that you need and use ( !1 types of program slots to 
their test advantage. V.lien we are successful, and help people^ It Is usually because 
we were at)le to connect with that person, work with them and ensure they got the 
services and support needed to reach their goal. When we fail, it Is most cften 
because v;e never made the Initial connectton wKh the person or we Just didnt have 
the resources to provide the services needed. 

3. Stats Cooperation In Supporting Programs And Providing Technical 
Assistance 

The State of Maryland Is a great example of what States can do to provMe leadership 
atid support for the JTPA system. Many of the programs that I dted ss examples 
of successful JTPA efforts In the City of Baltimore were n.ade possible by State 
support and State leadership. Some specific examples of the State's leadership 
role are: 

e The Federal JOBS Progrant 

Thia program, which we call Pro]eot in^iependenoe, was designed by the State to 
be a partnerstilp effort* In Maryland the State requires the PIC to form a tocal team 
that is msde up of our Welfare Omce Director, the k>cal school represenutfve and 
the SDA. This team le responsible for devotoping the operational plan for how aN 
the Federal JOBS funds will be apent. The State then anocates these funds directly 
tc the PlC. THIS was done so thst the welfare employment and training aystem could 
build upon - not dupOcate - the existing local employmeni and trtf ning systsm. I 
think that we may be the only state that la using the PICe In this type of role. And 
the results sre that the State obtalna more aen/teee for the welfare dtants than they 
wotJd have gotten If they had aet up a aeparate aystem. 

e The Maryland's Tomorrow Dropout Prevention Prooram 

I mentioned the Futuree Program earlier. Weil, FUturea la a pa/t of a larger state 
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•ffort called Maryfand't Tomorrow, iht Stale decldad that It ntadad to ac»v«(y 
work with atHlak high achool atudanta to try to lower the overall dropout rate, n atao 
decided that the beat way to deal with theee youny people was to inmate a chanoe 
In the way the schools approached this problem. This was done by uelng the PiCa 
as the change agent for thia effort Uaing JTPA 8% funds and an over increaalno 
level of State funds, the State aliocatee funds to the PICs to work direcuy with the 
echools to provide enhanced senrtccs to Mds who are In danger of dropping out. 
Willo the day-to-day operatlona are run by local school staff, the PIC Is respor olble 
for the overall coord]n&tk>n and admlnlatratlon of the progrm. 

And the State's fdadershlp role Is not simply limited to developkig new program 
models. They also provide leadership In a number of other aress. l prevloi sly 
mentfonod the State Initiative to foater a new PIC role and to develop a tocal work 
force Investment team that can cal upon all the local resources to addresa woik 
force Issues. Stin another example is my own committee's work for the State Work 
Force Board. This group has been grappling with the problem of young Afrtean 
Asnerlcan males dropping out of the mainstream society. We liave apent consider- 
able tin e trying to get a handle on this problem end design a comprehenaNe 
approach to deal with It I have Included a copy of the report we produced that both 
describes the problem and c utilnes a comprehensive strategy to deal wHh R. This 
to an example of tt.e type of policy paper that is widely disseminated end then 
fonowed up on by the State, who work wtth the locjrt players to Implement the 
recommencfatfons. 

Still another example of State aupport is the technical asslatance capacity they 
foster. Beyond doing the things that the JTPA law requires in provkfing te^nicai 
assistance to SDAs, the State has provided the resources and aupport lor the 
development of the Maryland Instftute for Employment and Training Profeeelonala. 
ThIa Is a staff development and technica! assistance unit that Is IndepenaenHy 
operated by the SDAs using several State ftmding sources. Hie State also provkfee 
resources and support for both the PICs and the SDAs to maintain professfone 
ctssocfaUone whteh provMe a peer to peer technical assistance capacity. 

WhMe an of the Maryland PiCs may not always agree with the spectflcs or what the 
State does, I donl think any of them wouM fault the State for not being aupportlve 
and endeavoring to provide leadership. They are an active partner tn an thMwe do 
at the local level and provide a leadership and support fufKJtlon thrt has made oir 
efforts much more eucceesfut 

4. A Profile Of The Population Tht PIC Servos And Tht Definition of 
Succsss 

I have read the erftlclem that some PICs only take the best people eo that they oen 
enstire positive reeulte. i ceni epeak to what other PiCs do but i can tel you that ki 
Baitknore, we wDrt( wtth the people who need help, 'meparttdpamaeervedbytht 
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Battlmoro City PIC are whot i would cat) very "high ^ Isk'' In terms of living In poverty 
and the oducatlonri and skllla c^oflclenclea ttiat they have. Tha ovarwhelmtng 
majority of tha people we enron desperately need education, employment, training 
and iupport aervlces In order to increase ttieir labor market potential so ttiat they 
can compete In the labor market and move towards self-suffdency. Let me provide 
you with some specific* characteristics: 

• Over 90% of the people vi^e enroll are minorities; 
e 46% wero single parents; 

e 51 %woro welfare reofpldnts; 

# 34% were school dropouts. 

In terms of measurSng program success, the PIC has made It clear that the ultimate 
goal Is to have IndWIduals get a jol> that wm enab! 3 them to bocome self-sufTlclem. 
This means getting Jobs for participants that either provide a good starting wage or 
provide the opportunity for advancement, u please me to report thai «ven though 
we work with some of the hardest to sen^e groups and we have • for the last two 
years - had a tight labor market and a decnmng Job base, 65% of the JXPk 
participants became empfoyedl 

We also measure our performance in a number of other ways. Using the JTPA 
National Performance System, we look at what the people In our pro^^ms earn 
over time and how many stay empk>yed fonowing the end of program parttdpatloii. 
While looking at the number of people we help got Jobs looks at perfonnance from 
t quantity perspectlvs> ih^e measurements provide us wfth more of a quail^ 
evatuttf on of our efforts. The PIC has had an exceltent record when Judged by these 
Natfonal standards. It has made or exceeded all of Its standards for every year that 
ttiey have been used In the JTPA system. 

The PIC also recognizes that there are Interim stops on the road to aeif-sufndency. 
For youth, the attainment of employment competenolta Is an Important measure of 
tnteilm success. This type of outcome Is also measured and ttw Pic exceeded tMs 
JTPA performance standard by over 20% last year. Another imeilm measure of 
success for adults is the attainment of a GED. The PIC sponsored pit)grams were 
responsible for 34% of all the OED admfnlsterod In Banimore city last year. TM 
shows the strong commitment the PIC has to long term solutions. I am vsry 
confident when i relate to you that In Baltimore city, the PiC sets some high 
expectations for the JTPA program and for all the years I have bsen associated with 
It, the program has met or exceeded our expectations. 

5. Rscommendattons For Improvino JTPA 

From the oomments I have made, by now you realize that I think JTPA In Baltimore 
Is pretty good, in fact, the one m<iJor change I would recommend would not even 
apply to JTPA m Bammore or the state of Maryland because the State and the CKy 
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are alrea<ly trying to make the chanoo. That change would be to pull more of the 
work force rnveatmdnt programa together $o that they become a real, Inteorated 
work force Inveetment ayatem. Throu(^ five or $!x different laws that you have 
pasaed over the years, you have Cieated at leaat fjvo different, malor woric force 
programa (JOBS/JTPA/Job Servlce/Voc.Ed/VocRehab) andprobably thirty or mom 
other, amaller programs. Just the other day I heard that the Defense Departniaitt 
was starting a 'Job Corps" typo program to be operated at military bases that have 
extra capacity. While this may be a good Idea, none of these programa are really 
required to do anything more than pay lip service to Integrating their servloea with 
all the ouier programs. The really amazing thing Is that there is a huge overfap in 
the people served by aD these different programs and I would eurmise thit a lot of 
dupncatlon in Information taking, asseeement and employabllJty planning also 
occura. rm not advocating that an of these programs be lumped together as one 
effort, but I ftm advocating mat States be required to sort through how nS of thsm 
work and to develop and use a plan that will make aenso and cut down on overfap. 
If we cou[ I do this we also could provide a mere seamless service delivery systsm 
and might even be able to develop the holy grail of the work force Investment syate^n 
- the ^ne-stop shop". 

My second recomi londstlon fs probably one you dont want to hesr. Leave JTPA 
alonefor a couple of years. It Is Just now li.iplememing the mi^or changes you made 
In the law last fall and H will be some time before we eee the full Impact of these 
changes. JTPA Is Just sbout at the sUge where it has matured aa a progmm. fiwiii 
aee the pasaing of its first decade later this year. I have heard of diacimlona that 
aince JTPA waa surted under a Repubncan admlnlstratton that It might well be 
terminated. Thia would be a very big mistake. jTPA Isn't perfect, but It is effective 
m most areaa and It la the only program that provtdca a real opportunity for an 
effective govemment and buelness partnership. Making addHlonal, nuior changee 
to JTPA at thla time would not bode well witit the local business cortununlly - imlny 
of them are etni grappHng wtth the recent amendments* ErKflng JTPA %tfoukl eend 
a dear meeeage to the buslnees community that thta type of partnerahfp la not 
importaniAtatfmethatweneedagQresstvebusInosaandgovernmernpailrre^ 
lo effectfvely deal wflh global economic competition, ending the one real Dartner- 
shlp program would be a huge mlatake. 

Iwenttoendmyremavka by noting that JTPA provided the opportunity to bitf da 
comprehenshre eystem to serve df sadvanUge people, f n Maryland and I euaoed 
the eame la true for many other 8tatee we bunt on tiile opportunity to expandand 
forge the befi^nge of a wortc force deftvery ayatem that encompaaaeeeo mu^ 
ISP'fl^ or indlng JTPA coukJ weR tear down 

«ile kifraauudurethat n has taken yeare to build, rm In the buameee of Uklng eoOd. 
okibuidlnge and biHdlnaonto them andmaWngthem better. iknowthieaMroocii 
RMkeeeenee. 1 wouki strongly reoofnmend that be the approach the Meitf 
govemment Ukee when It conakiere what to do wNh JTPA. 
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THE ACTION PLANNING GUIDELINES FOR LOCAL 
INTEGRATED WORK FORCE INVESTMENT SYSTEMS 



I. INTRODUCTION: 

Amorica t5 In o period of 6conomfc chaltengo - K has boen colled by somo experts an 
economic war. Our socoess In responding to this chaHenfle wiB Impact upon ©vwy 
person In tN* Nation. With tho clo3o o( th© Cold V/ar and the oponino of new markeia 
thf ouflhoul the world, tho potential for a producttvo and thrMng ooonomy based upon 
oxport expansion has never been 5'X)ator. If wo ore able to capitalize on this polontlK. 
our Nation wll thrive and continue to offer opportunity for our children to proeper and* 
maintain our standard of llvinfl. if we cannot compete. K directly translates Into shrinking 
opportunity for our youno people and to an erosion of our flvino standard as compared 
to our ifxiustrlanzod oompetltopB. 

While we won the Cold War. all Indicators point to the stark tect ti"«l we are kwlng thft 
economic war to our European and Asian competllora. The reasons why we are tosing 
are complex, but ovory expert agreos thai a malor factor - perhaps the single most 
Importarit factor Is that our work f )rce Is not as productive and skiHod as our 
competitors. Consequently, It la cr iticai that wo solve this problem. 

The Governor, In the Stale's Wo(1< Force Investment Plan, has set out a vision to 
address this challenge. The vision is for every citizen k\ Maryland to have th« 
opportunity to fully develop the sWIls and ablWos needed lo maxImUe Wo-tong 
eamlnge. TNs vlsfon includes providing Maryland employers with a highly sWded. 
productive, world dass Wortc Force Investment System that maximizes the efforts and 
resources of government. oducatk>n. business, and the conmjnity. Achieving IMi 
vision requires creatfno a Work Force Investment System with the epoclflo mission oft 
• Integrating programs unci rotourcos into a aeamlots tarvica 

dallvary ayalam that la kayad to local aconomic davalopmant . 

planning and Is cuatomar drtvan, provldaa battar accaas and 

producaa a work forca that la world class and capabia of 

oompating In tha global aconomy. 
Tho Govtmor and hit cabinet Wly lupport the fot^hg of such a tystem In Msryland. 
Tho Dopartmenta of Human Rwourcat, Eoonomk; and BrY^)loymant Dovetopmer^, 
Education and Higher EAwatton al have Joined Ihia effort md aro ple^ 

worit aa a team to bom creata a State Wori< Fofoa Invaatmant Syttem »k5 to 
•upport k)cal araat to do the aoma. 

A pr eraqulifta fcx orealino a Wof1< Porca Irw^mart Sy«am to that 
raeponaiWa far tha exWIng oora of wortc forca kwettmant proi^^ 
wording team that Jolna wfth tha private tw^jr and iolntty a^ 
foroa probtoma. The State haa aoch a pfenning end poicy teain tha 
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rof c« tnvesimenl Doerd (GWIO). Thds© Action Planning Quldefinos wil ^erv© to assist 
local areas In formally accompltehing the samo ~ bringing people who are responsible 
for programs together with representatives of the private sector \o work as a team so 
that thoy can forge a compreheaslve plan and a comprehensive, complementary 
service system for achieving work force Investment goals. The Side recognizes that 
many areas may already have comparable teams In place. This Initiative Is not Intended 
to duplicate existing efforts but rather expand their role and function. 

The pfenning guldollneo that follow have been designed to serve three Interrelated 
purposes: 

# To provide the parameters and focus for the drafting of a local 
Integrated Work Force Investment Action Plan; 

# To outline a process for local areas to use to create this plan; and 

# To establish, at the local level, a point of accountability for ths 
work force Investment system. 

IL GOALS AND OBJECTIVES: 

A critical element for developing a Work Force tnvesurtent System Is to establish a clear 
focus. Goals and objectives serve that purpose. Accordingly, the Governor has 
established two broad based goals tor the Work i=orce Investmerrt System. Included 
with these two goals are four focus areas that represent Important State tosuse. 
Goal: The Work Force tnvestment System will work to 
Increase the labor market attachment and Uibof 
market value of all M^ryf arKi citizens. 
Goal: The Work Force Investment System will Improve the 
delivery of seivtees, and make them more effecthrei 
efflcldnt, accessible and responsWe to the needs of 
both employers and people seeking employment 
Chaltonse improve School Pertormanoe: K (e firmly Mleved that 
Areas 1 : If we can Improve ttudent competencies while In 
school and develop a rational connecting system 
between school and work, many of our problems 
would be alleviated. Local areas are urged to work 
creatively to de^nyttlfy the workplace for echoole and 
de-mystIfy achoots to empfoyere eo that belter 
Intercctlbne can develop. Achlevemenia will be 
measured primarily by the Maryland School 
Perfomiancf Program, to Include: 
e Gradustlon Rtlte; 
e School Peiformsnce; and m tdditKHt 
• The Devetopment of Local School to Work/Educaflon 
Trantitk)n Syttem. 
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Improvft the Wolfara to Wnrt, TfBnnll lt?n- Trying to 
develop a quality Project Independence program 
within the constraint* of the Family Support Act la a 
continuing challenge. In addition, the national 
climate concerning welfare reform will be undemolna 
dramatic changes. It Is hoped that new resource!, 
new program models, more employer partlclpattor^ in 
grant dive ralon, on-the-Job-tralnlng (olm, . work 
experiences will emerge that will enhance and 
accelerate the move up from dependency 
Achievements will be measured by the Increase In the 
number of welfare recipients that are placed and 
retained In qufillty Job*. 
3. I ncrease Sen lce« For n..t ff^s t, ^^; y^m^,. -jj,, 

notional epecter of millions of out of echool youth ■ 
unemployed - alienated • and actively Involved with 
only one system, tfie correctional system • mutt 
change. Schools - community clubs ■ employers ■ 
recreation apeclallsts . career counselora ~ all must 
play creative roles In bringing young people 
partloulariy young males, back to their families and 
their communities as constnjctWe citizens and 
workers. Easier said than done. Achlevemente will 
^« f 'f'te tncreaselnZ Sers 

1^1 /h!?^ ~« 'Chool young 

males, that are actively engagecl In actlvltlas to 

hop«d mat the exp«tlse of the Caraer and 

.K *• Community College*, and 

the JTPA system working In concert urttti lo«U 

•rtlcutate skill 

Thw oo«ta aixl chaltengt «f tfi »ugQMl#d M »h« ■tartkm oiw. far 
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first planning phase. Ths other focus areas can be addressed in a later plan 
modincalkm. The k>cal team shouW oooeWer eddiog eddWonal goele and cheUenge 
areas as needed to address apedfic labor market proWems In their jurlsdtetloa 

If a Piani ilng Team befieves that a Stale focus area has beon adequately addressed In * 
thoir Jurisdiction and no longef presorrts a problem. H can concentrate the planning 
effort on the remaining challenge areas. Furthernwe, If the local team believes that 
another, tocal Issue is more critical than a State focus area and resources do not 

currer^tly exl$t to address both the local Issue and the Stato chalter^oe areos, k may opt ♦ 
to substitute the local Issue for one of the State chaOenge areas with a brief explanattoa 

III. RESOURCES: 

A number of Federal, State and local resoirces are available that can potentially be 
used to address wori< force Issues. The key ones are Isted below. Programs receiving 
funds from the following resource streams should be asked to parttelpalb with this effort. 

# Thd Job Training Partnership Act Funds; 

# Th0 Wagnor-Peyser Act (Basd Grant); 

# Community CoHege Funds (Careor and Continuing Education 
Prograrr,s); 

# Stato and Federal Vocational Technical Sductsijon Funds; 

# JOBS Funds; 

# Maryland'a Tomorrovf Funda; 

# State and Federal Adult Baste Education Funds. 

At local discretion, other programe can bo Included such as Community Development 
Block Grants, Hearth and Human Services funds, HUO resc irces, locai career - 
education funds, vocational rehabilitation, siate and iocs* economic dev^pmeot 
resourcea. 

IV. THE PLANNING TEAM: 

The success of this important em>rt It contingent upon the existence of an acth/e 

planning team o4 coequal partners, each bringing different reeourcee and Inslflhu to 

•here with the group as focuses on the critical woik force Iwoes that fa^ 

communfty. border to avoid unnecessary duplca!kxt«)d to buM upon ajdsil^ 

rystemt, Prtvata Industry CouncUe. are being asked to aot as the fadttatora oT «8 

planning proceas. They are encouraged to take tWe opportunity to lead the way to a 

productive and irndgratedpartnerahip or aOthaoencemedenUtJes at the locill^ But * 

the GVVIB recognbea that sorne Prh^ IndUtlry Councfla h the State may fK)t 

comfortable w»h assuming tuch an enlarged JeadenWp role. Therefore,^ 

convening the Team for its frst meeting. If the PIC decWea not to take on the IMK^ 

role, the specilk) relet of the pertkilpating groups, ak)ng with the WentHk^ 

to assume the teedershlp role, shouW be dackJed by the maMty of the team mwT^ 
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The ptennJnQ teem partners should tndude: 

• Tho PIC Chair or a PiC Business Member (Planning Team 
Convener); 

• The Job Sorvico Managor(s) from each Jurisdiction reprosented; 

• The Pre$ld9nt(8} of any Community College In the area; 

• The SDA Director; 

• The Social Sarvico D!rector(8) from each jurisdiction 
represented; 

• The Superlntendcnt(8) of Schools from each Jurisdiction 
represented. 

At ihe discretion of the person{5) Identified, designees who aro authorized to act for 
the teem menritw cwi bo named to the Planning Team. FuiihemfKye. In 
multi-juriedlctional areas, other mQirtbershtp arrangements may b# considered $uch as 
Team members from a particular agency selecting a single roprosontatlvo to actively 
participate and be the spokesperson for the entire group. 

U is strongly encoiiraged that the team seek to Invofve other employers, perhaps 
Incorporating employers that are active with the loc«l advisory councns for the local 
areas' technic^ progran^. rurthermore, the Teem shoUd seek Input and participation 
from other loc^ government and community based organiiatlone, arxJ from the not for 
profit sector that are pmvlding workforce sen/toes. such as adult aducatton, 
correctk>nal educfttk)n, economk: devetopment. vocational reheb(1Hatk>n seivk^es, 
health, housing, ete. 

Staff support for the team can be provided by any or afl of the agencies partfclpeting 
with the effort. K is dear that ih© Tc "im virflt rely upon good stafi work In order to make 
this endoQVor a suooesaful one. Becaitoo of the orttk^ nature ttsA support plays ki this 
type of undertaking, the specltto plan for staffing the Teem must be a mutualy 
acceptat>le arrangement for the majority of the Team membefs. 

The State hopoe to provk^o a capacity bulding planning grant of $15«000 to every team 
(not to exceed 12) \Mhk^can be used for stalT support. Locel progrwns ere 
encouraged to supplement and support those funds w1Ui addtional cash and Wv kind 
resources. 



The k}low(ng outlne has been estabSshed for each srea to use to devekjp a plan. 
A. Mission 

Each plan shoukidevsk)p«staten>entth«tk5ent{fk>8theQfver-archtngn^^^ 
totaS Wort< Force Investment fiyetem. This mbektn should be rsfledfvs of the goals 
endobjocOvesstlpi^etedlntfwso gukielnee. 



V. PLAN OUTLINE: 
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B. Goals and Objective 

The chanenoe ar^aa Identified In Section II mi/or «ny kx») cheJtenoe areae should 
Issue dear measurable outcomee be developed so they can be usodX^ 
0. Th© Planning T«am 

• names »nd orflanlMtlonal tmiUttoM of •» th« t««m membert- 

• A brlrtdMcrtpUon of how the team w»» staffed; and ' 

• h^l"!' future, mcludlna 
how overelflht of plan wni bo Kcompn^hed In the upcoming Xntg ' 

D. Current Effort 

THIS weflon of tfw plan should briefly Identify current elTorta and resources that are 
t. Planned lmprov«m©nu 

Thte section Should WentiV the cheJenge areas that have been selected bv the 

Section VI - TTme Frarrws). A Wef descriptloo of how the ^us toorWvi 
^c^v.. be used ,0 address t^a':Us.x,u«^p^T^^ 

• 'n\9 overan ipproach/J^Ian of action 

• 8p«cined«nocatlonofro»oiMce»A)iKlg»t 

• OutcomaaaxpactKl 

• CoHabonrtlon plannad 
F. Ikporting Syatam 

• Whatrtporta/datawaib^raqulfttf; 

• How will tuocaMbatftflnad; 

• What band) maiKpafiod/dtltwIlbautad; 

• Whowtlbaraqulratftoraport; 

• Tr»i*fttquancjrorrtporti;and 

• ^•*OK>WH>pac»oobaaadoii«»tr«porti, 
Q. Planning Qrant 

«i»n prowed to feclltrtt the devetoprtmit of the pl*i iTKVof to 
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the ooQoing ptennlog and monRofkio Process. The furxSs can also be used to fcjster 
Inkoges and/or Inlerageocy cooperaHon. Inckjde In this descfiptk>n the time frame* 
for expor>drtuf e and the what speclfteolly w8! tje purchacod wfth the fufxJa. 

H. Program Agreamonls (Optional Section) 

It may be helpful and productive foe agencies to formulate agfoomeots to outline 
collaboraUvo oporailon$ end Integrated activities. If egrecmenis are tjelng 
developed, provWe a Ixlef description of which agencies sod the focus of the 
agreement (or attach a copy). 

I. Concurronca 

All major Team members Involved should show their concurrence with the plan by 
lignlng-off on the plan. 

VI. TIMEFRAMES: 

The first planning cycle wil be three years and the time frame covered by the plan will 
be 1/1/94 to 12/31/96. Cr«cal dates (or the current plinnInQ cycle are: 

• Publication of final planning guidelines by tho Stata ^ 6/1/93; 

• Submission of Phase 1 plan to Stata ^ 11/30/93; 

• Connmonts from tha Stata on the local plan - 12/30/93; 

• Submission of Phase 2 plan to State 0/30/95; 
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Questions About tho Integrated Plan 
Process 

1. Why Is an Integrated plan needod? 

Many of the gnsclvdd work force Invosimoni Issues cut oaoss the boundartos of Stole 
and local agencies. No one agency has til the resources and expertise needed to 
adequately address those cross cutting Issues. An integrated plan Is the best way to 
eftectlvoty begin tho process of dealing with these Issues. Furthermore, tho private 
sector has not tradlHonalfy taken an active role In planning for or addressing human 
resource development Issues. Since they are ultimately expected to provide lobs for 
tho people that take part in these humon resource development jnltlaSves, they need a 
way to be actively involved. The development o< an Integrated planning process and 
approach provides such a mechanism. 

2. With ail tho changes about to take place, why atart an Integrated 
planning process now? 

To paraphrase a former President who paraphrased a former Chinese phik^sopher, "A 
journey of a thousand miles begins with or* step". We have a very lor^ v/ay to go to 
address the crItlcaJ workforce investment issues that confront us. We cannot afford to 
wait. It b true that many of the programs that wiR come under this process face a future 
thai will be charactorUed by change. The type ofjokit planning and Interaction 
envisioned to be a port of the integrated planning process should In every Instance 
assist these agenciee and programs better respond to the changes they may be asked 
to make. An example of this Is the current JTPA system. The recent amendments to 
the Federal law require a number of speciffe linkages and coordinated efforts that are 
very much In line with the scope and purpose of the imegroted planning effort. 

3. What do I, a$ the head of one of the participating organizations, 
stand to gain by participating with this effort? 

The way the Integrated planning process has been outlined, palidpattng organlzattons 
stand to gain a great deal and risk very little by participating whi i effort. Given the 
assumption that the chaBonge areas selected by the State (or thoee thet wfl be 
gelocted by tho Teen^) represent critical ccmmunfty Isaues, the teem provides the 
agency head wtth an opportunity to Impact on the utffzatton of other resource etreaiis 
that exist In the commurirty that cooW be used to address these Isauee. For agency 
teadora that have the reeponslblilty tor In^ovtng the Ives quafty of Bfe In t^ 
ccmmunfty this Is an opportunity that seldom proeents Itself. Furtf)emnori. the ablBty to 
work directly with other decision n^akers k) the community and sJiare expertise *id 
resources to forge a collaborative approach to address these Issues shouki be an 
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OKi'iitardtlng exp«Heno«. 



4. Doas Ihe State plan to use tho Integrated Plan at a control 
document? 

Whila the Stat© will revldw th« plan, it is not a Stato control doojit^nt It 1$ envlsbnod 
that the local team will uso tha plan end the process estatrtslied locally to monitor 
knplttmaniatlon as an accountabllty ioo<, but tho State wtd not. ft Is anticipated that the 
plan narrative submitted to the State Annually will Include a brtof summary of the 
I rogroas made. It Is not planned that any formal reports wlB be required by the State 
relative to the plamed actMties. 



5. Does tha plan require the team to establish a new and/or an 
additional reporting system? 

Nol The plan guidelines do encourage the team to establish an accountability process 
that Includes a feedback mechanism and reports. But this system does not need to be 
A new one. At local option, existing reporting systems can be used or modifled to fit the 
needs of the team. 



e. If the PIC Chair leads the teom, does that mean the PIC staff muat 
pro^ Ide the sta?f support for ihe team? 

This Is a local decision. The Slate fuDy realzes the critical need for adequate staff 
support for this effort. Unfortunately, adequate resource do not currentfy exists to 
provide each area with the resources needed to underwrite appropriate »taff support It 
Is hoped that a« the organizations InvoK/ed wm contribute to provide the staff support 
needed to make this effort work. Another approach could bo for one organization to 
take on the lead role fOr staff support for a one or two year period and then pass thb 
responsbllity on to another organization that Is a part of the Team. 



7. Is tfils Team- Just the PIC? If not, how Is It different from the PIC? 

No. the Team b not the PKX This Is not to «ay that the PC. if alpteyers agreed, 
cannot soivo as the TeamI Sound oonfming, tot ut explaK From Pederarf legislative 
perspectfvej«rtc^«llw on the PIC has » very dHferent foout . PIC membera come 
togettier prtmarih^ to talk sbou end to speoHtealy decWe how to 
and the other resources Ihe State hes opted to channel throui^ the PICs. The Team 
white It may 1^ many Inetancee be ihe same peopte, are decteton 1^ 
together to tal< ibot^ overarching toeoet ind to try to fwap out a 
Interagency/Hergovernmeftal approaches tor deeing wWi theee lesues. These 
epproachet ehouW take into accourt •« retourcea atreame t^ 



wtth Ihe leeue. 
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That dtetinciion madt , If th« mombers on tb« Teem Wove that using the entire PIC es 
the Team la a productJve way to develop and monitor an Integrated plan, they can 
certainly proceed In that fashion. 

8. Is the planning team bolng 8dtHjp to determine how al! the dotiars 
are to be spent In the resource streams In the plan? 

No! The planning team should be viewed as a partnership group coming together to 
(0CU3 on spcciTtc challenge areae. Each of the partners la a 'general partner thsi 
brlngo to the team particular resources and expertise. The team, as a group will work 
to get f* handle on and address some very difficult State and local issues. Hopefuly, 
eao' * 'm member wtl pailicipato In mapping out these approaches and be able to 
materially help the effort. But cleariy, this may not always be feasible. In the final 
analysis. It will be up to each team member to detemrilne the effective way to assist with 
the whole team effort. 



9. What happens If the Team maps out an approach, but one Team 
member refuses to cooperate? Can the Team make that 
organUatton cooperate? 

The tearn (a§ defined as the primary group of organizations listed in the pfenning 
guidelinds] Is e group of equals with each team member exercising unilateral control 
over the resourcee that they sre legaRy responsible for. If en approach has been 
mapped out, and one team member has deckled that their onganizstfon cannot play the 
role ouiHned for them, there Is no legal power the team has to change that deciskxi. 
This Is why K Is cdtical for the team to {oimtyv^ together to develop approaches. His 
difficult to errvlslon a scenaHo where all team mennbers Jointly develop an approech and 
then after It has been agreed to. a specific member refusing to folow through. After al. 
the Teem focus on cross cutting Issues that the team wit be focusing upon. Issues t)%el 
tff the Team members have a staks In addressing. 

10. Will the State make the organlzttlons It funds cooperate? 

The Stats has a funding rslatk)nshlp with al o( the Team members (as defined In the 
planning guidelines). Essentiaity, two dfferem funding retatfonshlps eoOst One Is a 
direct retatkxishlp, v^retheTeamrT)en«)erlsactuanyaSt8teefnployee. andtheothe^ 
IB a contractual or grant relatk)n8h^ where the State channels funds to a pertlcuier 
organization. In both Inetsnces, The State plans to aggressively encourage teem 
members to actively parltelpate wftli this eflbn 



The state lntcr>ds lo provide Its empfoyees wtfi a measure of flexft)llty to respond 
tie team process and stands ready to offer Its empkyyees technical asslstsnce In 
posttlvety responding to Ideas and epproeches that devetop from the teem tntersctkxv 
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But m no Inatanco dow th« Stala imofxl to •strong arm' eKher Its staff or th« 
offlanlzattofts to v4ilch I channels funds. This would litimatoiy be counter productive to 
ths buHdIng of effectivo local ratettonshlps. 



11. Does the teem need to address the four challenge areas Identified 
in the planning guidelines? 

Tho chononge areas Identified In the planning guidelines represent crftlcal 'peopte 
problems' that the State Is trying to address. Obviously, If these are critical State 
•people problems', they are local area 'people problenr^g' as well, 'nierefbre, In most 
Instances, the challenge areas kJentifled In the planning gtidellnes wffl be chalenge 
areas thai exJst In local areas too. if, In the opinion of the majority o( members on the 
team, one or more of the challenge areas Identified In the planning guidelines has been 
or Is being adequately addressed, the Team need not spend time planning for this 
chanenge ar^a. A)l that Is requested Is that the Team provide a JqM statement ouUnlng 
why that particular challenge area Is not a problem In their area. 

12. Can Teams pick other challenge areas? 

Yes, the team can and Is encxauraged to eelect additional challenge yeas that ore 
bellevod to be Important worfc force Investment Issues that need to bo resolvwi. 



13. How will the State support this Initiative? 

The State plans to support this InWetlve In a number of ways. Rrst. once the planning 
guidelines are Issued, a planning conference wHI bo held. The purpose tor the 
conference w«t be to bring prospective team members together^ to outnne the 
C^ldeHf^es a -id to start the planning process. Secondly, the State currently p^ lo 
prosrfde a $' 5,000 planning support grant to each area to provWe a mWmum level of 
resources trte Team can use to tecHtate the plan development and/or monitoring 
process. Lastly, the Stato wU provide ongo»r>g technical asstetanoe to help local taams 
In this endeavor, 

■/ I . 

14. Is t|ils a ona shot deal? 

Hopefuly noy The need for our stale to devetop s wofW class yyork ferc^^ 
capaWi of succeeiMy funcliontxj In a h^ 

one thot problem, ft wfl take time and oominued effort lo achieve ttyimabtcrin such a 
workfbrce.Anlnttgratsdk)calplannk)gsndaocountMty process Ha step thitwl 
help uf adileve this goel. Therefore, It Is a process, that Is tuooessfui. •h(^ 
to be used to respond lo cross cottiTTO wortc force hveatmertt is^jes. 



1 5. What happens If we decide not to estat>llsh a team and to develop 
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a local Intogratad plan? 

in a few words, nothkig win heppenl No formal toam will bo put in p*ac«. No Iniegraied 
plgmnlna wW take plaoe. And In all probtf)«lty, Ittte In the way of oomprehonalve, unified 
acttona wB occur to addro9s the slflnificant work force Issues that con^ont ua. In short, 
tho community tosos an opportunity to address some very Important tesues and an 
opportunity to forge a formal working relationship wtth the leaders in the community 
that determine how human resources Issues are addressed. Furthermore, you lose 
time In movli\g towards a more effective and efficient way of doing the business of 
human resource development. 

le.Who do I call for additional Information or If I hava question*? 

Call Jim Callahan, the number Is 41(^33-5606. 
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Mr PETORSON. Thank you. Thank you, Mr. Struever. Ms. Irving. 

Ms. iKvma. Thank you. fl'^ S'^^S?i^^''''^Str.A'c^ 
bers of the subcommittee, 1 f^Jf ^"5' JTS Uve given me the 

approved a new ™f 5^ ^^'HfTe'-job Opportunities and Basic 
Training Partnership Act '"^,|?°" gien clear direction by 

r^»aS|irn« - 

'::^^^T^ S ?SS-,!LWyl tol Oient-focused/ 
employer-driven system. opnnpntial training process, or 

a EKriSr I^creTo SSiy' with LV.e bar- 

™£ri;i«e PIC had ana hayumdent funds J serve^ie^s 
than 5 percent of the "mmu"jty '1^^^^ are more expensive 

KteTaff rSld°L'e;^S|e IS fands and services whenever 

Ifl^^l feasible to.offset feX's'ucL S% integrating our 

We began the l»vera Wroces» W "'^^^^^ 
Job Training P"g!''*'^,t* *"„aZ Cve compatible goals and 
SL''eTw?intff a^d^*- ?n^Pe. We reduced, if not ehmi- 

and 1 see Mr. Machtley is reading it^o that is wnat we 

S rS«™1n"pSS;; HC^pay s bstantially more but 
rJJ^r less Sian $6 per I'o-'.P'"^ JSiTutS' and recruitment. We 
ha'^e^rSSS Srs,""!* c'c^X assistance offices, and 
seven job centers. , "Fortune Center" for initial as- 

ra^ra^^ic^a-^i'^^^^^^^^ needy; long- 

and children; Jug °ffend^^^^ ^^^.^ older workers, 

teen parents; at-nsk youtn in population to work with, 

and dislocated workers. We common denomi- 

Just to mention some of the client protiies ana including 
nators, I would just ike toj-yj^-^ Zd If-confidence. Most of 

JS"c?^ls"Sdi^^^^^^^^ - ^" ^^^^^ 
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skills— job skills, interpersonal skills, and critical thinking skills, A 
significant number of them need high school diplomas or GEDs, 

Welfare recipients with children will not leave welfare for mini- 
mum-wage jobs and no benefits. Dislocated workers who have been 
laid off from low-skilled, high-paying jobs need extensive training 
for occupations that pay considerably less, which is often ft difficult 
adjustment for them. 

The assessment outcomes determine at what point the client en- 
ters our system. We use a sequential training process as follows: 

The phase I, which is the easiest, is training readiness. That is 
where we thoroughly assess the most difficult-to-serve clients, and 
weprovide immediate activity to increase motivation, 

Tne second phase is a feeder program. Our clients who are leav- 
ing the first phase can either go into a feeder or into phase III, job 
specific skills training programs. 

I think in your packet I tried to include a client flow chart, I 
have one on the floor which is big and pretty, but I think it would 
take too long, so I am going to ask you to make reference to that. 
Because of the time, I'm trying to move through this process. 

All of our programs are extremely comprehensive because we are 
looking at the client from a holistic perspective, and we think it 
works, and it works very effectively. We want to see them once. We 
want to give them the tools for life. 

Our method of instruction: We used competency based instruc- 
tion to measure and monitor the client's progress throughout the 
proCTam, This kind of positive feedback also builds self-esteem and 
selfconfidence. 

We monitor programs programmatically and fiscally on a month- 
ly basis according to the terms and conditions of the contract. 
When problems are identified that require immediate attention, we 
remain involved until the situation is corrected. 

The statistical data that I will share with you is based on an $8,6 
million budget. We served 2,433 people, 67 percent black, 18.5 per- 
cent white, 8.6 Hispanic, Eighty-eight percent of our clients lacked 
a significant work history; 62 percent were receiving public assist- 
ance; 25 percent were high school dropouts; 37 percent were read- 
in^ below seventh ;^ade levels. 

Our average cos^ per enrollment is $3,555 — quite a difference 
from $10,000, which I think I heard someone mention earlier. So 
there is a way of leveraging your dollars and being very cost effi- 
cient and cost effective. 

In terms of Federal and State performance standards, for 2 con- 
secutive years we have met all but one. The last year, the entered 
employment rate for dislocated workers, we missed by a hair be- 
cause when Congress voted the UI extension benefits, our clients 
decided not to go to work. They didn't want to accept employment. 

Like my colleague to my left says, we are facing a very tight job 
market with mass layoffs and plant closings in the city and sur- 
rounding counties. As a result of that, we instituted a new PIC 
business partr.:;rship, which we call the business advisory council 
[BAG], They are composed of 14 major corporations who provide 
technical assistance to us. 

We did not say to them fBAC] that we had all the wonderful 
qualified people. We wanted to understand the shifts and changes 
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in the job market. They have made many recommendations to us, 
but I would like to just point out one that I think is the most sig- 
nificant to the Philadelphia Private Industry Council. 

It was strongly suggested by the BAG that we develop a central- 
ized job development unit, a concept of one-stop shopping for em- 
ployers, to motivate them to become much more involved. From 
their standpoint, it would reduce recruitment and training costs as 
long as our training programs are producing qualified applicants. 
Then there would be a very good match. 

As a result of the PiC-business partnership, we are in the proc- 
ess of establishing the centralized job development unit and we ex- 
pect it to be fully operational by July 1993. 

What works: This is what we think works. 

Apprenticeship models of training — theory and hands-on experi- 
ence — are the most effective methods of training the harder-to- 
serve adult and youth populations. Unfortunately, these programs 
are generally the most expensive. However, all program designs 
should be comprehensive, holistic, and capable of removing social 
barriers to employment while cultivating job-specific skills that 
lead to permanent employment. 

An indepth assessment of the individual's basic skills, interests, 
and aptitude is critical to the process of matching the client with 
the most appropriate training activity. 

Employer involvement in programs, particularly the curriculum 
design, instruction, and the use of intiemships is absolutely nec- 
essary, because employers are the ultimate customers of our prod- 
ucts — the trained workers. 

What doesn't work: Quick-fix solutions — short-term training — do 
not produce durable outcomes for the harder-to-serve clients. 

Single-focused programs or stand-alone activities do not work 
and are not cost-effective. 

Ensuring the effectiveness of our programs: We do it in several 
ways, whicn I really want to concentrate on. 

First, we start off with a competitive RFP or request for proposal 
process. Our proposers are guided in the design of comprehensive 
training programs by making certain that specific components are 
adequately addressea, namely: Remediation, life skills, job develop- 
ment. Proposals that do not meet our guidelines are not accepted. 

Second, proposals are not only analyzed by the operations staff, 
but they are also preaudited by the finance department to ascer- 
tain the reasonableness of costs. 

Third, all training programs are then reviewed by the PiC's pro- 
gram evaluation committee [PEC], which is a subcommittee of the 
PIC's board, comprised of seven members from the private sector 
in the human resources areas. The PEC is responsible for the over- 
all evaluation and selection of programs and makes funding rec- 
ommendations to the PiC's board of directors for final approval. 

Fourth, contracts or legally binding documents between the PIC 
and its subcontractors must be fair and equitable, with terms, con- 
ditions, and performance criteria clearly defined and legally en- 
forceable. 

Fifth, and of course, I have mentioned before, briefly, the exter- 
nal and internal monitoring process. 
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The recommendations to improve the effectiveness of JTPA: I 
come at this from a different angle, only because we have so many 
partnerships. I think that, at tne local level, we become awfully 
frustrated, simply because different funding streams don't seem to 
talk to each other or work with each other very effectively. 

If I had a wish list, I would wish that all Federal agencies be- 
come a little bit more consistent in their regulations, definitions, 
income eligibility criteria, MIS data. I'll give you an example of 
what I am talking about. 

A welfare recipient who is receiving income through HHS, living 
in subsidized housing — [HUD] — who attends PIC training pro- 
grams — Labor — is screened by three federally funded agencies, has 
three sets of paperwork, three sets of files, documentation, reports. 

Work experience wages received by the client while in a [JTPA] 
training program, could cause a recfuction in her welfare benefits 
and an increase in her rent. It just seems that altogether the sys- 
tem is very, very counterproductive. It makes our jobs, at the local 
level a lot more difficult. 

While we do strongly advocate the passage of the amendments, 
we only wish that the allocation formula had taken into consider- 
ation the number of disadvantaged people that the major cities are 
working with. One out of five people in Philadelphia is receiving 
some form of welfare. 

I would like to close and simply say that we strongly believe that 
JTPA has the chance to succeed where no other government pro- 
gram — manpower or CETA — has even come close. So far, JTPA has 
the most effective track record based on what the Federal perform- 
ance standards have measured over the years. Mainly, that focus 
has been on the number of people placed in jobs. 

Our experience shows that the private sector must be closely 
linked to any successful employment and training initiative. PIC's 
and JTPA already have established relationships with the private 
sector which, if enhanced, can yield greater results and benefits to 
the clients we serve and to the economy in general. 

Thank you. 

[The prepared statement of Ms. Irving follows:] 
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TESTIMONY 



Executive Officer n. ^' P'^esident and Chief 

PhiladelDhia T Private Industry Council of 

Partnership Act since 1984 Federal Job Training 

client- focused/employer-driven' system. ^-^^^^^^ recused to a 
Through the Request for Proposal (RFP) process thP ptp 

:^?c^r in°d' c^a^se'^"^" pro^^'ssit^aY%L^^ns^Un^g 
SkTTJf ('T<=?f . " • "^"^3^"'^"'' ^" addition to Job Specif iE 
pre'traiS (feeder'," Type'' of'' 0™^^=?"' -">P--^ " 
-difficult-?o-se^e^ clV?nt8 fo? %kTll h°,. ^/^^t" 
L't^e^ft ™^ a^p'roach'^'orKe^'^iid'ir^orKe'd^'^eve^ 

a^^ r-ac. lp^pli^"a„r;e^°dd^e"i''a ^S^? e^^^S^^^^ 
readiness coitponent in January, 1992. training 

^h^h^^o^.^/' ^""^ utilizing a sequential training process or 
f.nJ% structure to transition "harder- to- se?ve- cliln?s 

from dependency to self-sufficiency. oerve clients 
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We began the leveraging process by integrating JTPA and JOBS 
since both prograins had compatible goals and outcomes. By 
integrating two programs into one, we reduced, if not 
eliminated, duplicate administrative costs . We also 
coordinated the delivery of support services with County 
Assistance to address the diverse needs of the harder- to-serve 
clients . 

The PIC s partnership with County Assistance has worked 
exceptionally well and continues to flourish. But more 
importantly, this experience encouraged and propelled the PIC 
to form other partnerships throughout the community which is 
explained in the PIC's Progress Report. 



2 



153 



150 



PHILADBLPHIA PIC*S APPROACH TO TRAIKIKG AMD PCPLOIflClKT t 

The Philadelphia Private Industry Council only funds training 
programs in occupations where jobs exist . We specifically 
seek placement in positions that pay substantially more but 
not less than $6.00 per hour plus fringe benefits. 

A. Itttcruitmant: 

The training process begins with outreach and 
recruitment. There are three primary sources of 
appl icants : 

■ Six (6) PIC Referral Centers- -Community -Based 
organizations strategically located throughout the 
city in areas of high unemployment. 

■ Nineteen (19) County Assistance Offices--The PIC 
co-locates staff at each County Assistance office. 
PIC Client Service Representatives and Employment 
and Training personnel (ETP) at County Assistance 
work together to recruit and screen welfare 
recipients for PIC programs. 

■ Seven (7) Job Centers- -located throughout the city, 
PIC staff are scheduled in each Job Service Center 
to recruit applicants for PIC- funded training 
programs . 

B. ABSQssaent C%nt%r: 

All applicants are referred to the "Fortune Center" for 
initial assessment. We use a computerized series of 
tests (3 1/2 hours) to measure each applicant's basic 
skills, interest and aptitude . Test results are 
discussed with each applicant . Program options and 
choices are presented to the client and the assessment 
counselor makes recommendations, but, the client 
exercises his/her right of final selection in most 
instances . 

Populations served: 



Long term welfare recipients 
Transitionally needy 

Long term unemployed/disadvantaged adults 

Homeless 

Drug offenders 

Ex-of fenders 

High school dropouts 

Teen parents 

At-risk youth (in and out of school) 
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■ Older workers 

■ Dislocated workers 

Client prof iles- -conmon denominators: 

■ Most clients, including dislocated workers, 
generally lack self-esteem and self-confidence. 

■ Most clients, including dislocated workers, are 
deficient in basic skills, job skills interpersonal 
skills and critical thinking skills. 

■ A significant number of clients need to acquire a 
high school diploma or GED equivalent while 
building basic skills in preparation for skill 
based training programs . 

■ Welfare recipients will not leave welfare for 
minimum wage jobs with no benefits. 

■ Dislocated workers who have been laid-off from low 
skilled/high-paying . jobs need extensive training 
for occupations that pay considerably less which is 
often a difficult adjustment. 

Based on assessment outcomes, an Educational and 
Employability Development Plan (EEDP) is completed by the 
assessment counselor and the client. According to the 
EEDP, the client is referred to the appropriate program 
in the sequential training process. 

Description of S«q;u«nti«l Training Process: 

The PIC operates three -phases of sequential training 
programs to assist individuals in gaining the 
educational, occupational and job preparation skills they 
need to enter and succeed in the work place. The 
sequential phases, the populations served, the curricula 
and the expected outcomes include: 

Phase I: Training-Readiness Program 

The purpose of the first tier of training is to: 

a thoroughly assess the client's basic skills; 

■ provide an immediate activity that will help 
sustain client interest in training; 

■ increase client motivation for success; and 

■ prepare clients to successfully participate 
and complete either PIC feeder or job specific 
skills training programs. 

The Training Readiness Program provides the following 
services to harder-to-serve Philadelphia residents who 
possess little or no work history: 
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■ Introduction to Basic Skills (reading, writing 
and math) 

■ Life/Coping Skills 

■ Counseling 

■ Case Management 

Each year, an estimated 25-30% of PIC s trainees will 
attend the Training-Readiness program, which operates 
from 2 to 6 weeks with staggered entry and exit . 
Training Readiness Program participants transition into 
a PIC- funded feeder or Job Specific Skills program. 

Phase II: Feeder Program 

The purpose of the second tier of training is to assist 
trainees in: 

■ increasing self-esteem; 

■ gaining realistic employment goals; 

■ elevating academic skills; 

■ removing barriers to employment s access; 

■ obtaining coping and life skills; and 

■ acquiring knowledge of the job market and the 
skills required to enter it. 

Feeder programs serve harder- to- serve Philadelphia 
residents who possess little or no work history, are PIC- 
eligible and are reading between the f? , 0 »n<? ^,9 grade 
levels. Trainees also include graduates of PIC's 
Training -Readiness program. 

Comprehensive feeder programs include: 

■ Basic Skills 

■ Life Skills 

■ Job Readiness 

■ Career Exploration 

■ Counseling and Case Management 

Each year, an estimated 20% of PIC's trainees will attend 
feeder programs, which vary in length from 10 to 16 weeks 
with staggered entry and exit. 

The feeder program outcomes include transition into a 
PIC- funded Job Specific Skills program, a non-PIC funded 
program, or a full-time unsubsidized job (minimum of 30 
hours per week) at a wage of $6.00 or more with eitqployer- 
sponsored (at least 50%) fringe benefits. 
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Phase III: Job Specific Skills Program 

The purpose of the third tier of training is to assist 
trainees in: 

■ obtaining specific occupational or job skills 

■ elevating bc.sic academic skills; 

■ preparing for success in the world of work 
(job readiness) ; 

■ obtaining coping and life skills; and 

■ acquiring knowledge of the job market and the 
skills required to enter it. 

Job Specific Skills programs serve harder- to- serve 
Philadelphia residents who possess little or no work 
history, are PIC-eligible and are reading at or above the 
Xufi grade level. Trainees include graduates of PIC's 
feeder system and/or Training-Readiness Program. 

Comprehensive Job Specific Skills (JSS) programs include: 

■ Occupational Skills 

■ Basic Skills 

■ Life Sicills 

■ Job Readiness 

■ Counseling 

■ Case Management 

Each year, nearly all of PIC's trainees will attend job 
specific skills programs, which operate from 4 to 9 
months in length. 

The outcome for Job Specific Skills programs is placement 
into a full-time unsubsidized job (minimum of 30 hours 
per week) at a wage of $6.00 or more with employer- 
sponsored (at least 50%) fringe benefits. 

Mf»thod of Instruction: 

We use competency -based instruction to measure and 
monitor the client's progress, or lack thereof, 
throughout the program (Positive feedback to clients also 
builds self-confidence and self-esteem) . Most PIC- funded 
programs utilize a staggered enrollment process whereby 
a specified number of trainees are enrolled each or every 
other month. Graduates exit the program when all 
competencies have been fulfilled and placement has 
occurred in a training- related occupation. If a trainee 
is not ready to exit the program we advise our 
subcontractors to work with the trainee until she/he is 
completely trained and prepared to compete in the labor 
market . 

6 
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Monitoring: 

PIC- funded programs are L^onitored programnatically and 
fiscally on a monthly basis according to the terms and 
conditions of the contract. When problems are identified 
that require imnediate attention, we remain involved 
until the situation is rectified or remedied. 

We also monitor our internal operation programmatically 
and fiscally according to performance goals, objectives 
and the operating budget, as approved by the Board of 
Directors . We troubleshoot internal systems and 
procedures and collect and analyze data to measure 
progress and the cost effectiveness of the organization 
and that of our training providers. 

P«rforaanc«: 

The Philadelphia PIC has exceeded all federal/state 
mandated performance standards for two consecutive years 
with one (1) exception the Entered Employment Rate for 
Dislocated Workers. We missed the standard by a hair. 
A significant number of clients in the dislocated worker 
category elected to collect the extended benefits rather 
than accept employment. 
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III- BPSIIUSS ADVISOftT COPlfq XL 

Facing a tight labor market, massive layoffs and plant 
closings in the City and surrounding counties, we instituted 
a new PIC- Business Partnership, called The Business Advisory 
Council (BAG) . 

nlJ^T Business Advisory Council is composed of 14 major 
Philadelphia based employers and/or industries. These 
employers have the experience and expertise to train their 
employees and they are willing and well-prepared to provide 
technical assistance to the PIC. 

The Council members have made the following recommendations to 
the Private Industry Council (PIC) regarding structural 
changes ip the labor market: 

■ ^;j?.^o the current job market trend focusing on multiple 
skills PIC training providers should be encouraged to 
train participants more generically and for a wider 
variety of jobs. For example, the inclusion of a strong 
math component, either bookkeeping or accounting 
principles, enhances the marketability of PIC graduates 
in a variety of clerical occupations. 

■ The major hiring characteristics for many entry level 
positions include: computer literacy, excellent 
communication skills (interpersonal and critical thinking 
skills) and previous work experience. Therefore, a 
component that focuses on interpersonal and critical 
thinking skills should be added to all training programs. 

■ BAG members advised us that internships, apprenticeships, 
and/or OJT might be considered as substitutes for 
previous work experience by many employers. They also 
held the position that a centralized job development 
strategy would be very effective in today's economy. 

■ BAG members think that PIG trainees can gain meaningful 
work experience from the temporary positions which are 
expected to materialize after the Family Leave Act 
becomes effective in August, 1993 as an alternative to 
internships and/or OJT. 

■ BAG members have expressed interest in being involved in 
the sequential training as PIG training providers and/or 
consultants. They are also interested in the development 
and implementation of a "train the trainers" program for 
PIG subcontractors. 

■ BAG members are interested in assisting us with post 
assessment by administering the fourth tier of training 
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for graduates from one or several subcontractors who were 
not successful in securing permanent jobs at the end of 
training. In fact, BAC members as a group expressed an 
interest in forming a consortium to conduct clerical 
training . 

■ A centralized Job Development Unit (one stop shopping for 
employers) is a strong motivator for employer involvement 
primarily because it would reduce recruitment and 

• training costs for employers as long as applicants are 
well trained. 

Afl a result of the PIC-business partnership, the PIC of 
Philadelphia has begun to combine its resources with member 
companies of the Business Advisory Council. Together, we are 
in the process of: 

■ Establishing a centralized Job Development Unit (one- stop 
shopping for employers) in partnership with the Business 
Advisory Council, County Assistance Office and Job 
Service We are in the process of renovating space to 
accommodate a multi- faceted Job Development Center to 
post -assess PIC graduates before placing them in 
positions that lead to economic self -sufficiency . 

■ Standardizing curricula to produce state of the art 
training which will be consistent with the needs ot 
businesses, today and in the future. 

■ WorJcing with member companies of the Business Advisory 
Council to implement state of the art training programs 
in clerical and allied health occupations for ?IC 
trainees who successfully completed at least one of the 
programs in the sequential training process, but did not 
secure employment at the end of training. 100% placement 
is the ultimate goal. 

in so doing, we will achieve multiple benefits; PIC graduates 
will be prepared to meet the competitive personnel needs of 
businesses and close the s)cills gap; we will be Prepared to 
support a local economic recovery; and we will be able to 
assist our clients in achieving economic self-sufficiency. 



9 



160 



167 



IV. IMTKOaATIOy WITH TRAIMIMQ. KDUCATION k SOCIAL SKR VICK SUPPORT 

The existing partnerships and working relationships to 
leverage PIC funds and resources on behalf of PIC trainees 
are: 

Board of Directors: 

A progressive, proactive Chairman of the Board and an actively 
involved, well-informed Board of Directors act as PIC 
ambassadors and identify potential resources in the community. 

Agencies and Organizations : 

County Assistance, Philadelphia School District, Philadelphia 
Department of Commerce, Philadelphia Department of Recreation, 
Employment Service, Greater Philadelphia Chamber of Commerce, 
Office of Housing and Community Development, Mayor ' s 
Commission on Literacy, Mayor's Commission on Aging, Mayor's 
Commission on Homelessness , Philadelphia Housing Authority, 
Philadelphia Industrial Development Corporation, Philadelphia 
Citywide Development Corporation, Greater Philadelphia Urban 
Affairs Coalition, United Way of Southeastern Pennsylvania, 
and the Business Advisory Council. 

Colleges and Universities : 

Community College of Philadelphia, Temple University, Lincoln 
University, University of Pennsylvania, Pennsylvania State 
University, Drexel University, Beaver College and Pierce 
Junior College. 

Foundations : 

William Penn Foundation, Pew Charitable Trust and the Beech 
Corporation . 



AFL/CIO, 1199C Hospital Workers Union, Glazier's Union Local, 
and the Philadelphia Federation of Teachers. 
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HHXT woaxsi 

■ Apprenticeship models of training {theory and hands-on 
experience) are the moat effective methods of training 
the harder-to-serve adult and youth populations and 
generally, the most expensive . However, all program 
designs should be comprehensive, holistic and capable of 
removing social barriers to employment while cultivating 
job specific skills that lead to permanent employment. 

■ Based on the "Garbage In, Garbage Out" theory, an in- 
depth or accurate assessment of the individual's basic 
skills interest and aptitude is critical to the process 
of matching the client with the most appropriate training 
activity . 

■ PICs should seek to enhance employer involvement in 
programs, particularly in curriculum design, instruction 
and the use of internships. Because employers are the 
ultimate consumers of our products -- trained workers -- 
we must obtain their input for developing a product that 
will be useful . 

■ Programs which serve adult learners, such as those 
involved in JTPA Title IIA, who have failed in 
traditional education settings must incorporate non- 
traditional learning techniques into their training 
programs . Furthermore , programs should all use 
significant hands-on skills training and basic life 
skills instruction. 

■ Employment and training systems should be "seaLmless" -- 
there should be no gaps in instruction or in timeliness. 
Clients, once motivated to enter training, must be able 
to get immediate attention and should not need to wait 
for program openings and lose their encouragement. 

■ To meet the ultimate goal of JTPA Title IIA, PICs must 
understand that job development is not an activity that 
occurs at a client's graduation. Job development must be 
an integral part of the design of any program because it 
must meet the needs of employers. 
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IfgXT DOISK 'T MOMCl 

■ Quick fix solutions (short term training) do not produ( 
durable outcomes for the harder- to- serve clients. 

■ Single focused programs or stand alone activities do n 
work and are not cost-effective. 
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VII ♦ KNSURING THS KPFgCTlVKNESS OF PROGRAMS 

The Philadelphia pic ensures the effectiveness of its programs 
in the following ways: 

■ Through the competitive Request for Proposal (RFP) 
process, proposers are guided in the design of 
comprehensive training programs by making certain that 
specific components are adecjuately addressed, e.g. 
remediation, life skills, and job development . Proposals 
that do not meet PIC guidelines are not accepted. 

■ Proposals are not only analyzed by the Operation's staff, 
but also pre-audited by the Finance Department to 
ascertain the reasonaJolenesc of costs. 

■ All training programs are reviewed by the PIC's Program 
Evaluation Committee (PEC), a subcommittee of the PIC's 
Board of Directors, comprised of seven (7) members of the 
human resources and/or staff development business 
community. The PEC is responsible for the overall 
evaluation, selection and funding recommendations of 
programs to the PIC Board of Directors. Meeting monthly, 
PEC assesses program designs and projected outcomes 
against industry standards. It also reviews previous 
performance and compares performance and costs to those 
of other similar training subcontractors. 

■ Contracts or legally bindin9 documents between the PIC 
and its subcontractors are fair and equitable, with 
terms, conditions and performance criteria clearly 
defined and legally enforceable. 

■ The external and internal monitoring process: 

External: PIC staff visit training program sites on a 
monthly basis interviewing both clients and program 
staff. The program is also monitored according to the 
terms and coiditions of the contract and the finance 
department monitors spending and program expenses. 

Internal: V,e consistently monitor internal systems and 
procedures to determine the operation's effectiveness. 
Measuring our performance and progress towards PIC goals 
and objectives is closely monitored fiscally and 
prog ramma t i ca 1 ly . 
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VTTT. RXCCaQCKMDATIOMS TO IMPROVl THI irFICTlYIMIS S 
JTPA/ASSKSSMi arr or JTP^ AMgHDigWTS 

■ A number of our suggestionB for improving JTPA were 
reflected in the recently enacted Job Training Reform 
Amendments of 1992. Examples are: 

We strongly agree with Congress and the 
Administration that an in-depth assessment is the 
key to delivering the individualized services that 
will lead to success in training amd on the job. 

We agree that lin)cages with education and welfare 
organizations are necessary to diversify the 
services we offer and to reach the population that 
needs us most . 

■ JTPA could be more effective if there were better 
coordination among ALL federal agencies in tenns of 
regulations, definitions, income eligibility 
requirements, MIS data. For exaii^>le, a welfare (HHS) 
recipient living in subsidized housing (HUD) who attends 
PIC training (JTPA) is screened by three federally- funded 
agencies and has three sets of paperwork, three sets of 
files, documentation and reports. Work experience wages 
received by the client while in a training program can 
cause a reduction in welfare benefits and an increase in 
rent . 

■ While we strongly advocated for the passage of the 
amendments to improve services across the board, we were 
disappointed by some good policies that were changed and 
others that were not addressed at all. Most significant 
of those issues not addressed was the JTPA funding 
forrmila. While we accept Congress' challenge to work 
with the most disadvantaged population, we were 
frustrated to learn that funding would still be based 
largely on unemployment figures and not on the 
economically disadvzmtaged. Other policies which were 
added under the amendments, such as more stringent 
targeting and certification rules, will create more 
restrictions and paperwork while minimizing flexibility 
at the local level . 
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IX. RaSPOWSl TO MDRC KVA LPXTIQN OF JTPA 

The Manpower Development Research Corporation (MDRC) 
evaluation of the Job Training Partnership Act under Title IIA 
had significant design flaws which have led to the publication 
of results which absolutely can not be accepted as accurate 
and can not be applied to the entire system with any degree of 
accuracy . The most significant discrepancy in the study 
involved the use of a random sample of cities; unfortunately 
the saunple was by no means random. In fact, cities had the 
option to participate in the study and the largest city used 
had a population of only 200,000 individuals. It is well 
known that large and small cities vary widely in their 
approaches to training, program design and especially client 
populations. All of these factors have an impact on the 
results of any study on employment and training. 

In light of the new JTPA amendments and the age of the study, 
it would be more fair to the system and its clients to perform 
a truly random study once the PICs have had an opportunity to 
implement the new changes to the JTPA system. 
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CONCLUSION ■ 

Overall, we strongly believe that JTPA has the chance to 
succeed where no other government program, like Manpower or 
CETA, has even come close. So far, JTPA has the most 
effective track record based on what the federal performance 
standards have measured over the years. Mainly, that focus 
has been on the number of people placed in ^o^s-. ^^V"" 
experience shows that the private sector must .^^ closely 
linked to any successful employment ^ndj: raining initiative. 
PICS and JTPA already have an established relationship with 
the private sector which can be enhanced to yield greater 
benefits to the system and the clients. 
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XI. 

L 



JTPA Tide OA 78%, 3% 
Program Year 1991 
Statistical Information 



UL 



Participants Served Number 

Adults 1,148 

Youths 1,158 

Older Workers 127 

TOTAL 2,433 

Client Demographics 

Client Racial Composition 

Black 1,634 

White 449 

Hispanic 210 

All Others 140 

Male 8S3 
Female 1.580 

Client Characteristics 

Lack Significant Work Histor>' 

2,140 

Receiving Public Assistance 

1,515 

High School Drop Outs 612 
Client Reading Levels 

Above 7th Grade 1,539 
Below 7th Grade 894 

Client Wages 

PiaOR to JTPA 

Wage Rale (w/prior work history) $6.39 

Wage Rate (w/o prior work history) $0 
Welfare Payments $383.66 
Enrollment Costs 

Average Cost Per Enrollment: $3,555.00 

Adult $4,400.00 
Youth 2.910.00 
Older Worker 1,805.00 



Percentage 

47.2 
47.6 

100.0 



67.2 
18.5 
8.6 
5.7 

35.1 
64.9 



88.0 

62.3 
25.2 



63.3 
36.7 



POST JTPA Percentage 
$7.08 10.8 

$6.42 100 

$38.91 (89.9) 



Total Expended: 



$8,650,260.00 
17 
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P.ICJ CUENrrLOW CrJAffr 



JOB 
PLACEMENT 



t 



JOB SPECIFIC SKILLS 

• Occupational Skills 

• Basic Skills 



i 

I 
I 



Job Readiness 
Career Exploration 
Counseling 



I 



NON - PIC 
FUNDED 
AMS 





TRAINING-READINESS PROGRAM 

• Life/Coping Skills 
Intro, to Basic Skills 
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Mr. Peterson. Thank you, Ms. Irving. I appreciate it. Next, we 
are going to hear from Jon Gerson. 

STATEMENT OF JON A. GERSON, DIRECTOR, OFFICE OF 
ECONOMIC DEVELOPMENT, MONTGOMERY COUNTY, MD 

Mr. Gerson. I am honored to have been invited to appear before 
your subcommittee today. I hope that my briei remarks will assist 
you in your examination of the effectiveness of the JTPA and our 
Nation's PIC's and employment and training initiatives in general. 

Obviously, when it comes to creating a community, and even a 
Nation, that is economically competitive, the most important thing 
that we have to do is to have an economy in which everyone gets 
to participate and be their full height. That is why effective em- 
ployment and training programs are so important. 

Immediately upon assuming office, the current county executive 
of Montgomery County made employment and training a priority 
for his administration and insisted that several changes to the net- 
work take place. I would like to briefly present some information 
on why this decision was made and what Montgomery County is 
attempting to achieve by revamping the way it designs, operates, 
and evaluates its job training endeavors. 

By way of background, Job Training Partnership Act programs, 
until recently, were administered by our local community college. 
Our private industry council acted in an advisory capacity and pro- 
vided basic oversight of these endeavors, but did not have any legal 
authority over their operations. 

In 1991, the Montgomerj^ County Private Industiy Council incor- 
porated as a nonprofit entity and became the official grant recipi- 
ent and administrator of all Federal and State mandated employ- 
ment and training programs. This important move was coupled 
with a transfer of oversight responsibility on the part of the county 
government from our department of family resources, which has a 
social service orientation, to the office of economic development, 
which I direct, which is oriented toward the needs of business. Our 
feeling is that matching people with jobs is a business issue, not 
a social service issue. 

In reviewing why Montgomery County government has made a 
concerted effort to embark on a new direction for its job training 
system, several factors come to mind: 

The first is that the county government recognized that its most 
valuable asset was its highly educated and skilled work force. In 
fact, we put together our strategic plan for economic development 
around enhancing our labor force. 

Montgomery County, MD, is becoming much more diverse. We 
now have more homeless, more speakers of English as a second 
language, and immigrants, than ever before. 

Our county's economy — and certain key industries, such as bank- 
ing, retail, construction, and real estate — are not going to operate 
as they have in the past. While they were the key drivers of our 
economy in the past decade, it is clear that the Federal laboratories 
in our community, like NIH and FDA, along with the high-tech in- 
dustries which support them, are the ones that are going to create 
jobs for all sectors in the future. 
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The training needs of our local companies are becoming much 
more complex as emerging forms of technology enter the workplace 
on a daily basis. 

Government, having declining resources, is being forced to de- 
velop cost-saving measures. If the recession has offered us any op- 
portunity, it is an opportunity to refocus and to repriontize so we 
can figure out how to be more efficient and emerge from the cur- 
rent recession in an even more competitive manner. Indeed, we are 
learning how to do more with less. 

You are aware that the changes I have described are not unique 
to Montgomery County, and can be found in your own districts and 
throughout tha Nation. The decision to redirect employment and 
training systems is taking place throughout the country. 

Let me point out. however, that while the Montgomery County 
PIC is responsible for taking our employment and training system 
in a new direction, they are not doing it alone. We are ensuring 
that the PIC has a close working relationship with not only the of- 
fice of economic development, but with other county entities such 
as our health, social service, school system, and housing endeavors. 

The organization is also building a quality partnership with our 
local business community. We consider the direction to be a three- 
way partnership in terms of a public, private, and nonprofit part- 
nership. 

To be candid, we really didn't have a choice or any alternatives 
in making the alterations I have described. We recognize that 
change is imminent, and, unless we respond to our changing envi- 
ronment, we are going to lose our competitive edge. 

Do JTPA programs have the ability to adjust to external factors? 
More importantly, do they have the capacity to facilitate the kind 
of change which may be needed in the Nation's employment and 
training system? If not, alterations in the law may be necessary. 

Montgomery County is mandating its private industry council, 
which as I said, is the official administrator of all our job training 
programs, to embark on two important functions: 

First, make employment and training initiatives more responsive 
to the needs of local employers; and second, act as the central hub 
for all job training efforts in the county. 

The private industry council has been directed to make job place- 
ment the key ingredient in administering Federal and State man- 
dated job training initiatives. This is based on the reahzation that 
unless we produce people with the right skills for the jobs in our 
community, we are really wasting our time. This is also easier said 
than done and dictates a new way of doing business. 

The PiC's and the JTPA programs need to be more responsive 
to the employers' needs ana respond to the ultimate goal of job 
placement. 

Labor market, demographic, and economic trends have to be ana- 
lyzed and projected. It doesn t make any sense in our community 
to teach people bricklaying when we project less construction activ- 
ity in the future. Meanwhile, nearly a third of our high-tech indus- 
tries are telling us that they can't find entry level people to put 
things in place or to deal with test tubes. 

The needs of the employers have to be communicated and unmet 
needs must be identified. There's a disconnect 
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Finally, there must be a matching vehicle to allow employers and 
job seekers to connect In Montgomery County's case, we are talk- 
ing about a centralized clearinghouse — a one-stop shop that is user 
friendly to both the small employer who, as you know, is the one 
who is producing most of the jobs, when he is seeking a worker, 
as well as for the job seeker. 

All of this implies a closer working relationship with the business 
community, a partnership which, in Montgomery County's case, 
has been facilitated by local government. 

We have also directed our private industry council to be the voice 
of the entire local employment and training system and to coordi- 
nate job training programs, whether they are funded through JTPA 
or not. We have insisted that all JTPA training activities be coordi- 
nated with the ancillary services which are needed to assist the cli- 
ents it serves. 

In addition to providing support for the administration of JTPA 
programs, Montgomery County appropriates an additional $3 mil- 
lion annually for 16 distinct employment and training programs. 
Many of these operate out of multiple geographic sites and through 
several nonprofit organizations and other institutions, such as our 
school system. 

At one point, we counted up tC' 65 different places with fiscal ties 
to the county government where a citizen could go to receive job 
training assistance or other seivices. This disjointed system, or 
lack of a system, has caused considerable frustration on our part 
as well as that of participants and employers. If you were a Jewish 
refugee from Russia, you went to one place. If you were a woman 
re-entering the marketplace, you went to another. It wasn't work- 
ing. 

To ensure the county is getting the most from its resources, we 
have asked our PIC to build an employment and training system 
which has a common mission among all the parts operating in it, 
which sets annual performance standards, and coordinates plan- 
ning, intake, and placement efforts. What we are attempting to do 
is to maximize those resources and eliminate any duplication. 

We feel this is critical to the effective functioning of job training 
programs and suggest that you examine the possibility of giving 
PiC's across the country, through their JTPA allocations, the fiscal 
resources necessary to develop this type of coordinated approach. 
While an important one, JTPA programs really are only one piece 
of a larger job training picture, and job training is only one aspect 
of what people need. 

We have found that the county government is at its best when 
it invests in catalytic endeavors — in this particular case, PIC is our 
catalyst — and provides the resources for others to accomplish a 
broad goal rather than attempting to control hundreds of individual 
pieces. 

We would urge you to consider this coordinated approach to em- 
ployment and training as you examine c\irrent JTPA legislation. 

I appreciate the opportunity to share Montgomery County's expe- 
rience with you. 

[The prepared statement of Mr. Gerson follows:] 
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TESTIMONY OF: 

Jon A. Gerson 
Director 
Office of Economic Development 
Montgoniery County, Maryland 



BEFORE: 

U.S. House of Representatives 
Government Operations Committee 
Employment, Housing and Aviation Subcommittee 
Chair: Representative Collin C. Peterson 

April 29, 1993 

I AM HONOREO TO HAVE BEEN INVITEO TO APPEAR TODAY BEFORE THE 
EMPLOYMENT, HOUSING ANO AVIATION SUBCOMMITTEE OF THE HOUSE GOVERNMENT 
OPERATIONS vOMMITTEE. I HOPE MY BRIEF REMARKS WILL ASSIST YOU IN YOUR 
EXAMINATION OF THE EFFECTIVENESS OF THE JOB TRAINING PARTNERSHIP ACT, OUR 
NATION'S PRIVATE INDUSTRY COUNCILS AND EMPLOYMENT AND TRAINING 
INITIATIVES IN GENERAL. 

IMMEDIATELY UPON ASSUMING OFFICE, THE CURRENT EXECUTIVE OF 
MONTGOMERY COUNTY, MARYLAND, MADE EMPLOYMENT AND TRAINING A PRIORITY FOR 
HIS ADMINISTRATION AND INSISTED THAT SEVERAL CHANGES TO OUR JOB TRAINING 
NETWORK TAKE PLACE. I WOULD LIKE TO PRESENT SOME INFORMATION ON m THIS 
DECISION WAS MADE, AND WHAI MONTGOMERY COUNTY IS ATTEMPTING TO ACHIEVE BY 
REVAMPING THE WAY IN WHICH IT DESIGNS, OPERATES AND EVALUATES ITS JOB 
TRAINING ENDEAVORS. 
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BY WAY OF BACKGROUND, JOB TRAINING PARTNERSHIP ACT PROGRAMS UNTIL 
RECENTLY WERE ADMINISTERED BY OUR LOCAL COMMUNITY COLLEGE. OUR 
PRIVATE INDUSTRY COUNCIL ACTED IN AN ADVISORY CAPACITY AND PROVIDED BASIC 
OVERSIGHT OF THESE ENDEAVORS, BUT HAD NO LEGAL AUTHORITY OVER THEIR 
OPERATIONS. 

IN 1991, THE MONTGOMERY COUNTY PRIVATE INDUSTRY COUNCIL INCORPORATED 
AS A NONPROFIT ENTITY AND BECAME THE OFFICIAL GRANT RECIPIENT AND 
ADMINISTRATOR OF ALL FEDERAL AND STATE EMPLOYMENT AND TRAINING PROGRAMS. 
THIS IMPORTANT MOVE WAS COUPLED WITH A TRANSFER OF OVERSIGHT 
RESPONSIBILITY ON THE PART OF THE COUNTY GOVERNMENT FROM OUR DEPARTMENT 
OF FAMILY RESOURCES, WHICH HAS A SOCIAL SERVICE ORIENTATION, TO THE 
OFFICE OF ECONOMIC DEVELOPMENT, WHICH IS ORIENTED TOWARD THE NEEDS OF 
BUSINESS. 

IN REVIEWING ML MONTGOMERY COUNTY GOVERNMENT HAS MADE A CONCERTED 
EFFORT TO EMBARK UPON A NEW DIRECTION FOR ITS JOB TRAINING SYSTEM, 
SEVERAL FACTORS COME TO MIND: 

1. THE COUNTY GOVERNMENT RECOGNIZED THAT ITS MOST VALUABLE ASSET 
IS ITS HIGHLY EDUCATED AND SKlLLbJ WORKFORCE, AND HAS 
FORMULATED ITS LONG-RANGE STRATEGIC PLAN FOR ECONOMIC 
DEVELOPMENT AROUND ENHANCING OUR LABOR FORCE. 

2. THE COUNTY'S LABOR FORCE HAS BECOME MORE DIVERSE, AND WE NOW 
HAVE MORE HOMELESS, ENGLISH AS A SECOND LANGUAGE STUDENTS AND 
IMMIGRANTS THAN EVER BEFORE. 
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3. THE COUNTY'S ECONOMY AND CERTAIN KEY INDUSTRIES SUCH AS 
BANKING. RETAIL, CONSTRUCTION AND REAL ESTATE WILL MOST 
LIKELY NOT OPERATE AS THEY HAVE IN THt PAST. 

4. THE TRAINING NEEDS OF OUR LOCAL COMPANIES ARE BECOMING MORE 
COMPLEX, AS EMERGING FORMS OF TECHNOLOGY ENTER THE WORKPLACE 
ON A DAILY BASIS. 

5. GOVERNMENT, DUE TO DECLINING RESOURCES, IS BEING FORCED TO 
DEVELOP COST SAVING MEASURES. 

AS YOU CAN SEE, THE CHANGES I HAVE DESCRIBED ARE NOT UNIQUE TO OUR 
COMMUNITY AND CAN BE FOUND THROUGHOUT THE COU^:TRY. THEY ARE ALSO MAKING 
THE DECISION TO REDIRECT OUR EMPLOYMENT AND TRAINING SYSTEM AN ESSENTIAL 
FUNCTION OF THE ACTIVITIES OF OUR PRIVATE INDUSTRY COUNCIL IN THE YEARS 
AHEAD. 

LET ME POINT OUT, HOWEVER, THAT WHILE THE MONTGOMERY COUNTY PIC IS 
RESPONSIBLE FOR TAKING OUR EMPLOYMENT AND TRAINING SYSTEM IN A NEW 
DIRECTION, THEY ARE NOT DOING THIS ALONE! WE ARE ENSURING THE PIC HAS A 
CLOSE WORKING RELATIONSHIP NOT ONLY WITH THE OFFICE OF ECONOMIC 
DEVELOPMENT, BUT ALSO WITH OTHER COUNTY ENTITIES INVOLVED WITH HEALTH, 
SOCIAL SERVICE, EDUCATION AND LOW- INCOME HOUSING ENDEAVORS. THE 
ORGANIZATION IS ALSO BUILDING A QUALITY RELATIONSHIP WITH THE LOCAL 

^-""MNITY. WE CONSIDER OUR NEW DIRECTION TO BE ONE OF A 
THREE-WAY PARTNERSHIP -- A PUBLIC, PRIVATE, NONPROFIT PARTNERSHIP. 
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WE REALLY DIDN'T HAVE A CHOICE, OR ANY ALTERNATIVES, IN MAKING THE 
ALTERATIONS I HAVE DESCRIBED, MONTGOMERY COUNTY REALIZES THAT CHANGE IS 
IMMINENT, AND UNLESS WE RESPOND TO OUR CHANGING ENVIRONMENT, WE WILL BE 
LEFT BEHIND. ANY SYSTEM BE IT JTPA OR EMPLOYMENT AND TRAINING OR 
EDUCATION MUST TAKE THIS INTO SERIOUS CONSIDERATION. 

DO JTPA PROGRAMS HAVE THE ABILITY TO ADJUST TO EXTERNAL CHANGES? 
MORE IMPORTANTLY, DO THEY HAVE THE CAPACITY TO FACILITATE THE KIND OF 
CHANGE WHICH MAY BE NEEDED IN THE NATION'S EMPLOYMENT AND TRAINING 
SYSTEM? IF NOT, ALTERATIONS TO THE LAW MAY BE NECESSARY. 

MONTGOMERY COUNTY IS MANDATING ITS PRIVATE INDUSTRY COUNCIL, WHICH 
IS THE OFFICIAL ADMINISTRATOR OF OUR JOB TRAINING PROGRAMS, TO EMBARK ON 
TWO IMPORTANT FUNCTIONS: 

1) MAKE EMPLOYMENT AND TRAINING INITIATIVES MORE RESPONSIVE TO 
THE NEEDS OF LOCAL EMPLOYERS; and 

2) ACT AS THE CENTRAL HUB FOR ALL JOB TRAINING EFFORTS IN THE 
COUNTY, 

THE MONTGOMERY COUNTY PRIVATE INDUSTRY COUNCIL HAS BEEN DIRECTED TO 
MAKE JOB PLACEMENT THE KEY INGREDIENT IN ADMINISTERING FEDERAL AND STATE 
MANDATED JOB TRAINING INITIATIVES, THIS IS BASED ON THE REALIZATION THAT 
UNLESS WE PRODUCE PEOPLE WITH THE RIGHT SKILLS FOR THE JOBS WHICH ARE 
AVAILABLE IN OUR COMMUNITY, WE ARE WASTING OUR TIME, THIS IS ALSO EAbl'^R 
SAID THAN DONE AND DICTATES A NEW WAY OF DOING BUSINESS, 
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IN ORDER FOR PICs AND JTPA PROGRAMS TO BE MORE RESPONSIVE TO 
EMPLOYER NEEDS AND RESPOND TO THE ULTIMATE GOAL OF JOB PLACEMENT, WE HAVE 
FOUND THE FOLLOWING MUST BE ACCOMPLISHED: 

* LABOR MARKET, DEMOGRAPHIC AND ECONOMIC TRENDS MUST BE ANAYLYZED 
AND PROJECTED. 

* THE NEEDS OF EMPLOYERS MUST BE COMMUNICATED, AND UNMET 
MARKETPLACE NEEDS IDENTIFIED. 

* PROGRAMS MUST BE DESIGNED IN RESPONSE TO THE NEEDS OF THE FUTURE. 

* AND FINALLY, THERE MUST BE A MATCHING VEHICLE TO ALLOW EMPLOYERS 
AND JOB SEEKERS TO CONNECT. IN MONTGOMERY COUNTY'S CASE, WE ARE 
TALKING ABOUT A CENTRALIZED CLEARINGHOUSE. 

ALL OF THESE IMPLY A CLOSER WORKING RELATIONSHIP WITH THE BUSINESS 
COMMUNITY, A RELATIONSHIP WHICH IN MONTGOMERY COUNTY'S CASE HAS BEEN 
FACILITATED BY THE LOCAL GOVERNMENT. 

MONTGOMERY COUNTY GOVERNMENT HAS ALSO DIRECTED ITS PRIVATE INDUSTRY 
COUNCIL TO BE THE VOICE OF OUR ENTIRE LOCAL EMPLOYMENT AND TRAINING 
SYSTEM AND TO COORDINATE JOB TRAINING ACTIVITIES WHETHER THEY ARE FUNDED 

.:r: 'mitlements or not. we have also insisted that job 

TRAINING ACTIVITIES BE COORDINATED WITH THE ANCILLARY SERVICES WHICH ARE 
NEEDED TO ASSIST THE CLIENTS WE AR^. TO SERVE. 
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IN ADDITION TO PROVIDING SUPPORT FOR THE ADMINISTRATION OF JTPA 
PROGRAMS, THE COUNTY APPROPRIATES S3 MILLION ANNUALLY FOR 16 DISTINCT 
EMPLOYMENT AND TRAINING PROGRAMS. MANY OF THESE OPERATE OUT OF MULTIPLE 
GEOGRAPHIC SITES AND THROUGH SEVERAL NONPROFIT ORGANIZATIONS AND OTHER 
INSTITUTIONS SUCH AS OUR PUBLIC SCHOOL SYSTEM. AT ONE POINT, WE COUNTED 
UP TO 65 PLACES, WITH FISCAL TIES TO THE COUNTY GOVERNMENT, WHERE A 
CITIZEN COULD GO TO RECEIVE JOB TRAINING ASSISTANCE AND ANCILLARY SOCIAL 
SERVICES. THIS DISJOINTED SYSTEM -- OR LACK OF A SYSTEM HAS CAUSED 
CONSIDERABLE FRUSTRATION AND CONFUSION ON THE PART OF BOTH PROGRAM 
PARTICIPANTS AND EMPLOYERS. 

TO ENSURE THE COUNTY IS GETTING THE MOST OF ITS PRECIOUS RESOURCES, 
WE INSTRUCTED OUR PRIVATE INDUSTRY COUNCIL TO BUILD AN EMPLOYMENT AND 
TRAINING SYSTEM WHICH HAS A COMMON MISSION AMONG THE PROGRAMS OPERATING 
WITHIN IT . . . WHICH SETS ANNUAL PERFORMANCE STANDARDS . . . WHICH 
COORDINATES PLANNING, INTAKE AND PLACEMENT EFFORTS. WHAT WE'RE 
ATTEMPTING TO ACHIEVE IS THE BEST USE OF SCARCE RESOURCES BY ELIMINATING 
ANY DUPLICATION WHICH MAY EXIST. 

WE FEEL THIS IS CRITICAL TO THE EFFECTIVE FUNCTIONING OF OUR JOB 
TRAINING PROGRAMS, AND SUGGEST YOU EXAMINE THE POSSIBILITY OF GIVING PICs 
ACROSS THE COUNTRY THROUGH THEIR JTPA ENTITLEMENTS -- THE FISCAL 
RESOURCES NECESSARY TO DEVELOP THIS TYPE OF COORDINATED APPROACH. WHILE 
AN IMPORTANT ONE, JTPA PROGRAMS ARE ONLY ONE PIECE OF THE JOB TRAINING 
PICTURE. AND JOB TRAINING IS ONLY ONE ASPECT OF WHAT SOME OF OUR 
CITIZENS NEED. 
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WE HAVE FOUND THAT GOVERNMENT IS AT ITS BEST WHEN IT INVESTS IN 
CATALYTIC ENDEAVORS IN THIS PARTICULAR CASE PIC IS OUR CATALYST AND 
PROVIDES THE RESOURCES FOR OTHERS TO ACCOMPLISH A BROAD GOAL RATHER THAN 
ATTEMPTING TO CONTROL HUNDREDS OF INDIVIDUAL PIECES. I URGE YOU TO 
CONSIDER THIS COORDINATED APPROACH TO EMPLOYMENT AND TRAINING AS YOU 
EXAMINE CURRENT OTPA LEGISLATION. 

THANK YOU FOR THE OPPORTUNITY TO SHARE MONTGOMERY COUNTY'S 
EXPERIENCE WITH YOU. 
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Mr. Peterson. Thank you, Mr. Gerson. Mr. Zeller. 

STATEMENT OF JOHN ZELLER, EXECUTIVE DIRECTOR, MONT- 
GOMERY COUNTY PRIVATE INDUSTRY COUNCIL, MONTGOM- 
ERY COUNTY, MD 

Mr. Zeller. Thank you. I am the executive director of the Pri- 
vate Industry Council of Montgomery County. I thank the Chair for 
the invitation to provide testimony todav. My comments should be 
seen in concert with my colleague, Jon Uerson, who has given some 
of the basis for the recent changes within the county as well as 
where we are heading. 

As he has said, our county advocates a strong work force develq)- 
ment system that is explicitly linked to business and economic lite. 
My testimony focuses on the implementation of this at an oper- 
ational level. 

All of us have talked about the delivery of JTPA programs. The 
question of what works and what does not is dangerously simplis- 
tic. 

Of course, when a service delivery area is able to piece together 
that constantly shifting, magical combination of a motivated client 
who needs the services that you provide, a competent service pro- 
vider that pulls together the skills training with appropriate 
preeifiplbyTheht and life skills training and jjossibly contextual re- 
mediation, and then have these services initially driven by a local 
employer who has a need for workers and has articulated it, then 
you have a successful program. I posit that this is the model of a 
successful, comprehensive program. Absent one of these elements, 
the risk of failure increases. 

The reality of the JTPA system as it has operated over the last 
number of years is that we work with many more people than can 
be served, all of whom qualify as eligible because of their inability 
to financially sustain themselves without relying on a variety of 
governmental assistance programs. 

JTPA is serving people who have not been served well by other 
institutions. For people with a solid work history, job readiness 
training may be sufficient to attain employment. But for most eco- 
nomicauy disadvantaged clients with additional barriers to employ- 
ment, skills training is essential. This skills training should always 
be combined with employability and work maturity training. Basic 
education as well as English as a second language should also be 
provided at the same time, according to need. 

Our private industry council consciously strives to serve its popu- 
lation in an equitable fashion. In the middle of this current pro- 
gram year, we have served approximately 1,900 people so far. 
Sixty-four percent are female; half of our population is African 
American; 14 percent Hispanic; and the remaining 11 percent 
Asian. These numbers reflect the growing diversity of our county, 
particularly the trend of the increase of our immigrant population. 

The amendments that have recently been passed do address 
some of the areas of concern that have come to light over the last 
number of years. As a national system, I think that this is good. 
Unfortunately, it tends to put unnecessary restrictions on jurisdic- 
tions—and I include the State of Maryland— that have been doing 
a fair and honest job. 
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As an individual responsible for operations at the local level, I 
believe that the amendments have oriented us in much more of a 
process system — assessment and referral — as opposed to outcome 
oriented. 

The amendments place much more emphasis on serving "at risk 
youth," the *1iard to serve," and "adults most in need," legislating 
the proportion of such target groups to be served. The objective as- 
sessment process mandated by the amendments would help to en- 
sure that candidates are properly assessed before referring them to 
employment and training programs. 

The requirement that such assessments trigger the enrollment of 
applicants into our MIS system and the development of an individ- 
ual service strategy for even those referred to other organizations 
for services, I believe, places a greater staff burden on the PIC and 
shifts resources away from clients determined appropriate for 
JTPA services. 

Generally, this emphasis on process translates into more paper- 
work for our staff to cope with and fewer dollars — precious aollars 
at that — spent on actual training and client programs. I fear that 
fewer people will be served because we are servine more paper. 

Additionally, due to procurement procedures that win be insti- 
tuted, *'off-the-sheir programs will predominate and smaller, non- 
profit and community based organizations, will have a more dif- 
ficult time participating as service providers. This would be unfor- 
tunate because it is entities such as these who tend to be the most 
flexible and responsive to changing labor market and social reali- 
ties, and these are the kinds of services that we believe need to be 
procured. 

Mainly, I fear that the amendments may set up the JTPA and 
the PIC system for failure because they draw resources away from 
direct training and support services. In discussions with my col- 
leap^es, there is a sense of apprehension that the language of the 
legislation and regulations is framed in terms of the ideal and in 
terms of the comprehensive. The reality is that much is being 
asked with insufficient resource and authority. 

I do not disagree with the goal of objective assessment and refer- 
ral, but I think we do not have the funds to be as all-encompassing 
as expected. I do not disagree with the goal of integration of serv- 
ices and coordination of programs, but I tnink that we, as a system, 
are being asked to shoulder responsibility and yet there are no 
mandates or incentives for other agencies and cLher programs to 
actively participate in such coordination. 

JTPA would benefit from more defined and realistic goals, dif- 
ferentiation between what are and who provides short-term and 
long-term interventions, and better articulation amone the ena- 
bling legislation and regulations of similar programs at tne Federal 
level, 

In general, I agree with my colleagues that PIC's should avoid 
isolated job placement programs for at-risk youth and focus on the 
occupational skills model, combining skills training, academic re- 
mediation, and employability skills development. 

Make no mistake about it — a program such as JTPA is needed, 
and succes^fal models ought to be adapted to local conditions. It is 
needed to provide a second chance for a large segment of our popu- 
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lation so they can participate in the economic life of our county, our 
State, our country. ^ ^ . ^ r i 

It is also needed by employers who require a system ot worker 
training that is flexible to their constantly changing demands. A 
public/private partnership, as utilized by JTPA, is also needed. 
Whether you call it a private industrj^ council, a work force invest- 
ment board, or a labor market board, it is critical to institutionalize 
and empower such a oartnership to rationally and effectively plan 
how an area spends all of its resources. 

I thank you for the opportunity of testifying today. 

[The prepared statement of Mr. Zeller follows:] 
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TESTIMONY OF: 

John Zeller 
Executive Director 
Montgomery County Private Industry Council, Inc. 
Montgomery County, Maryland 



BEFORE: 

U.S. House of Represeniatives 
Committee on Government Operations 
Subcommittee on Employment, Housing and Aviation 

REGARDING: 

Effectiveness of JTPA Title IIA in Meeting 
the Training Needs of Disadvantaged Adults and Youth 

My name is John Zeller and 1 am the Executive Director of the Montgomery 
County. Maryland Private Industry Council. Our Private Industry Council is an non- 
profit corporction that took over the Grant Recipient and Administrative Entity status 
of JTPA as of July 1, 1992. I thank the Chair for the invitation to address ti.e 
subcommittee on the issue of JTPA. 

My testimony should be viewed in concert with that of my colleague, Jon 
Gerson. As Director of the Office of Economic Development, Jon has spoken of the 
basis for the recent changes in our County, why it occurred, and where we are in the 
process of heading. Montgomery County strongly advocates a workforce 
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development system that is explicitly linked to its business and economic life. My 
testimony focuses on the implementation of these efforts, within that larger context. 

The question of what works and what does not can be dangerously simplistic. 
Of course when a service delivery area is able to piece together that constantly 
shifting magical combination of a motivated client who needs the services you best 
provide, a competent service provider that pulls together skills training with 
appropriate pre-employment/life skills training and possibly contextual remediation, 
and have these services initially driven by a local employer who has a need for 
workers and has articulated that need to you, then you have a successful program. 
I posit that this is the model of a successful, CQmorehensive program. Absent one of 
these elements, the risk of failure increases. 

The reality of the JTPA system is that we work with many more people than 
can be served; all of whom qualify as eligible because of their Inability to financially 
sustain themselves without relying on a variety of government assistance programs. 
JTPA Is serving people who have not been well served by other institutions. Within 
that universe there is a variety of levels of need and urgency. For people with a solid 
work history, job readiness training may be sufficient to attain employment. But for 
most economically disadvantaged clients with additional barriers to employment, skills 
training is essential. This skills training should always be combined with 
employabillty/work maturity training. Basic education as well as ESL should also be 
provided at the same time, according to need. 

Our Private Industry Council consciously strives to serve in an equitable fashion 
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1 those segments of the population that have deiDonstrated need, tn the middle of this 

2 current program year in all titles we have served so far approximately 1 900 people of 

3 whom 64% are fen^le. Half of our population is African American, 26% Caucasian, 

4 1 4% is Hispanic and the remaining 1 1 % is Asian. These numbers reflect the growing 

5 diversity of Montgomery County, particularly with the significant recent increase In 
8 our immigrant population. Our cost per participant averages $ 1 ,200.00. in addition 

7 to the performance standards of JTPA, our PIC is interested in how we have helped 

8 the community by linking businesses with jobs to people in need of them, career 

9 ladders, and longevity of employment. 

10 The JTPA Amendments do address some of the areas of concern that have 

1 1 come to light over the past number of years. As a national system, 1 believe that is 

12 good. Unfortunately it tends to put unnecessary restrictions on jurisdictions - and i 

13 include the State of Maryland -that have been doing a fair and honest job. As an 

14 individual responsible for operations at the local level, I believe that the amendments 

15 have oriented us in much more of an assessment and referral process system as 

16 opposed to an outcome oriented system. 

1 7 The JTPA amendments put more emphasis on serving "at risk youth" and "hard 

18 to serve" or "most in need" adults, legislating the proportion of such targets groups 

19 t^ be served. This directs the expenditure of JTPA funds to the most needy clients. 

20 The objective assessment process also mandated by the amendments ensures that 

21 candidates are properly assessed before referring them to an employment and training 

22 program. The requirement that such assessments trigger the enrollment of applicants 
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1 Into the PIC'S management information system, and the develop.nent of an Individual 

2 Service Strategy for even those referred to another organization for services, places 

3 a great staff resource burden on PIC's and shifts resources away from clients 

4 determined appropriate for JTPA services. Although the objective assessment process 

5 does take JTPA closer to the one stop shopping, I believe that proper tracking of all 

6 applicants assessed by this process should be done without formally enrolling clients 

7 into the MIS system. 

8 Generally this emphasis on process translates into more paperwork for staff to 

9 cope with and fewer dollars, precious dollars at that, spent on actual training and 

10 client programs. I fear that fewer people will be served because we are serving more 

11 paper. 

1 2 Additionally, due to the procurement procedures that will be instituted, "off-the- 

13 shelf" programs will pre-dominate and, smaller non-profit and community based 

14 organizations will have a more difficult time participating as service provioers. This 

15 would be unfortunate because it is entities such as these who tend to be vhe most 

16 flexible and responsive to changing labor market and social realities. And these are 

17 the kinds of services that need to be procured. 

18 Mainly I fear that the Amendments may set up the JTPA and PIC system for 

19 failure because they draw resources away from direct training and support serv.'ces. 

20 in discussion with my colleagues, there Is a sense of apprehension that the language 

21 of the legislation and regulations is framed in terms of the ideal and in terms of tne 

22 comprehensive. Ttie reality is that much is being asked with insufficient resource and 
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1 authority. I do not disagree with the goal of objective assessment and referral, but 

2 1 think we do not have the funds to be as ali-encompassing as is expected. I do not 

3 disagree with the goal of Integration of services and coordination of programs, but I 

4 think that we have been asked to shoulder responsibility and yet there are no 

5 mandates or incentives for other agencies and programs to actively participate in such 

6 coordination. 

7 Evaluation studies, such as the report of the Inspector General on JTPA, have 

8 generated a fair amount of criticism. I am torn between being defensive over having 

9 the shortcomings of the system pointed out (such as drop-out rates, low wage jobs, 

1 0 poor grade-level gains) and being in agreement of the criticism. I believe we have built 

11 in an Inheren t dichotomy between the hopes and expectations of working with people 

12 who have multiple barriers and ere hard to serve, and yet working within a JTPA 

1 3 system that is structured and evaluated as a short-term program. JTPA would benefit 

14 from more defined and realistic goals, differentiation between what are and who 

15 provides short-term and long-term interventions, and better articulation arr 'jng the 

16 enabling legislation and regulations of similar programs at the federal level. 

17 Evaluation studies do not show that JTPA does not work; it shows that there 

18 is empirical evidence that certain program designs are nrwa successful than others. 

19 The practical conclusion for PICs is not that JTPA cannot produce unsubsldized job 



20 placements and significant job retention, but that those models which have succeeded 

21 for similar target groups ought to be adopted. The National Research Council's Youth 

22 Emplovrrwot and Training: The YEDPA Years , concludes that occupational skills 
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programs targeted to out of school dropouts "resulted in both employment and 
earnings gains, reduced the use of welfare and unemployment insurance, and 
decreased criminal activity". There was no evidence presented in that report which 
shows the residential component to be essential to the above successful outcomes. 
Job placement programs for youth have produced only short term Increases In the 
rates of employment and earnings. PICs should avoid isolated job placement programs 
for at-risk youth and focus on the occupational skills model, combining skills training, 
academic remediation, and employability skills development. 

Make no mistake about it. A program such as JTPA is needed and successful 
models ought to be adapted to local conditions. It is needed to provide a second 
chance to a large segment of our population so they can participate in the economic 
life of our county, slate and country. It is also needed by employers who require a 
system of worker training that is flexible to their constantly changing demands. A 
public/private partnership, as utilized by JTPA, is also needed. Whether one calls 
them private industry councils, workforce investment boards or labor market boards, 
it is critical to institutionalize and empower such £ partnership to rationally and 
effectively plan for how an area spends its resources. 

I thank the Chair and the subcommittee for the honor of the invitation to speak 
before you today. 
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Mr. Peterson. Thank you all. This discussion we had earlier 
about what information is available, I assume ell of you have this 
information available that they claim is not available some places. 
You are not part of the problem there, are you? You can tell, at any 
riven time, how much you have invested in certain people and all 
that statistical information? 

Mr. Zeller. I would say in general that we have systems that, 
after a period of time — not necessarily easily — can identify the 
amount of resources that are invested in an individual, and we can 
come up with different characteristics like that. 

Mr. Peterson. Did you all develop your own software to do this, 
or how did you accomplish it? 

Ms. Irving. It has evolved over the years. We use what we call 
a participant activity tracking system. That way, we can track all 
case management activities and counseling as well. 

As I mentioned earlier, we use competency based instruction and 
we pay according to competencies. We like performance-based con- 
tracts, even though I know they are going, but we still use work 
activity plans. We really want to know how the client is progress- 
ing and we monitor it through computerized systems. 

Mr. Peterson. Did you develop these computer programs your- 
self? 

Ms. Irving. Yes, we did. 
Mr. Peterson. Did you? 

Mr. Struever. Yes. Our biggest issue, when you talk about infor- 
mation systems, as we have struggled through the management in- 
formation systems software issues, has been where we are trying 
to integrate with diflFerent programs and agencies. 

I think Pat's example is a good one, with a welfare employment 
program, where people are in public housing and can't take a job 
without paying more rent. That has been a big challenge for all of 
us, because everybody speaks different languages, has diflFerent 
definitions, different rules that they have to follow. I think by and 
large, we have made a lot of progress with that. 

One of the problems that we have had, as an example, is with 
tracking people through schools and then out of schools, getting in- 
formation out of school systems, so that the job training system can 
have what they have in terms of confidentiality, in terms of being 
able to use Social Security numbers. 

It is a pretty simple system through the unemployment insur- 
ance to be able to track after people are placed, which us 
businessfolk on the PIC are very interested in. That's the bottom 
line. Do they get a job? Do they stay in the job? Are they able to 
earn a family wage? 

One of the thing we are driving to is to get some better systems 
to get bevond the kind of stuff that the IG's office was talking 
about and to get the things that we think are really important. 

Mr. Peterson. B .t specifically, did you develop your own soft- 
ware, too? 

Mr. Struever. The city of Baltimore, yes. 

Mr. Zeller. Our management information system basically is 
something that has been developed by the State of Maryland that 
we feed into. 

Mr. PETtmsON. The whole State has it? 
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Mr. Zeller. Correct. The local financial accounting, however, has 
been left up to our jurisdiction. So particularly when we became a 
corporate entity, we developed our own software for financial track- 
ing. It would be better to have an integrated system in terms of 
the finances and MIS, but that is, I think, beyond the resources 
and the capability that we have. 

Mr. Peterson. You were talking about the — at some point I was 
not tracking it totally — about intervening at the eighth-grade level 
or something. How are you doing that? Are you in the school sys- 
tem? 

Mr. Struever. Yes. We have an active partnership with the city 
schools. It's a statewide program, Maryland's tomorrow, but it's a 
locally managed and designed program in each jurisdiction with 
each rIC/SDA, and so we have a team with the schools, with school 
department employees, funded in part through JTPA funds that 
pick up kids coming into high school in ninth grade and then run 
year-around in-school and out-of-school programs. 

Mr. Peterson. Wliy do you have to tell the school? Shouldn't 
they know that they should teach these kids how to read? Why do 
you have to go in and tell them that they have to learn how to 
read? 

Mr. Struever. Certainly a big part of it is trying to figure out 
uclU; ways — where traditional schooling is not working for these 
kids and they are on their way to dropping out — how we can inter- 
vene with some kind of nontraditional approaches to academics. 

Mr. Peterson. What happened here? You guys were all together 
and you found out this was a problem and so you sent into the 
school system and said, "Hey, these kids can't read and this is wh^ 
they can't get jobs and why they are getting into all this trouble'? 

Mr. Struever. Yes. 

Mr. Peterson. So you developed, with the schools, sonie kind of 
way to try to get at this? Is that what happened? 

Mr. Struever. The original motivation came out of one, employ- 
ers were saying, *Th8 jobs are available" — this was back when 
things were booming a little bit better in the mid-1980's— ;-and the 
applicants did not have the skills, so that the PIC was getting frus- 
trated in that they could not place people because they were not 
adequately educated. 

Therefore, we were getting involved with the schools. We had the 
commonwealth program that was based after the Boston compact, 
which was a series of graduation incentives. We were finding that 
the kids, when they graduated, either did not have the skills or, 
two, they were not graduating at all. 

Hence, there was a lot of pressure to get in with the school sys- 
tems and get serious about keeping these kids from dropping out 
and making sure they had adequate skills. 

Mr. Peterson. What did the schools say about this? 

Mr. Struever. The partnership has been a positive one, 
because 

Mr. Peterson. I understand. But when you went to them and 
said — I mean, weren't they working on this, or didn't thev care? 

Mr. Struever. To some extent the schools have welcomed the 
help, because a lot of the problems go beyond what a traditional 
school can do. Summer is a big part of the problem for these kids. 
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Middle-class kids that go to summer camp and have strong fami- 
lies behind them over the summers, they don t learn as fast as they 
do during the school year; but kids from city schools without fami- 
lies, witEout strong neighborhoods beyond them, lose everything 
they learned during the school year, and that is out of the scope 
of what schools can do. , , , 

Mr. Peterson. Why is that out of the scope? They could have 
year-round school. They could go to school from 8:00 to 5:00. Why 
is that beyond their scope? r • • 

Mr. Struever. Part of it is money and part of it is— those are 

all very fair questions to ask. .„ , - -e ^r.^r- 

Mr Peterson. They say that it will take less money if you oper- 
ate year round. In Minnesota, the legislature this year J^st put a 
proposal on the table to eo to a 12-month school year and extend 
the day to try to deal witli some of these other issues. Why do we 
have some other^program outside of the school to do what they 

"""^r^ STOUEVEif'This program is not outside the school I think 
that is the whole point. We are working m partnership with 
schools. To run a year-round school system — - 

Mr Peterson. I understand, but it comes from outside. You are 
not on the school board. You are not teaching there ,„,.t.^ 

Mr Struever. No, but the superintendent of the school system 
is on the PIC, so that is the partnership that works. So we run a 
year-romid school program, de facto, for these kids that are in seri- 

""^MrP^TERSON. Is that the best way to do things? Wouldn't it be 
better to do it in the school? . , 

Mr. STRUEVER. There is a lot of effort and discussion about 
school reform, which is an exciting thing. I think that JlPA and 
PIC°s is helping lead the way in school reform. Wc- are pushing in 

%?ie pusS on accountability and keeping kids in school that 
really need help and providing these kind of comprehensive serv- 
ices, and after school, and working with the families. That is what 

^UrPE^^oitldid not hear much talk about how you interface, 
all of you, with the higher education component of a 1 of this-un- 
less I wasn't listening. But again, that is something f se that ^oine- 
what troubles me. TTie higher education, vocational schools prob- 
ably are not training people for the jobs that are actually there. 

Are you also involved in those 

Mr. Struever. Partnerships, yes. . • u •> n„„ 

Mr Peterson [continuing]. Schools, trying to get the jobs.' Une 
of the things you talked about was that there is a disconnect.--that 
what people are trained for is not necessanly what employers need 
My jud^ent is that some of the problem is that the schools are 
not training kids, and they get locked into these programs and this 
turf, and tLy don't change with the times. Are you also pushing 

•"X^'zKLmi.Twould suggest that this is something that we are 
moving to that we see that it could be the local and higher edu- 
Sn& institutions as larger bureaucracies and their change is 
much slower. In effect, the JTPA system, I think has been asked 
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to do something that is constantly flexible, that is like a rapid re- 
sponse, and our measures of success are based on short-term 
thmgs. 

I believe that the colleges in our area do a good job, but they are 
primarily oriented to longer-term proCTams. We can feed into them 

f degree, but all of us, I think, have spoken about the 

end product as jobs, and an employer and job opportunities mav 
exist 4, 5, 6 months out, and you have to prepare people in a much 
shorter period of time. 

I think that working with the school systems more carefully, par- 
ticularly in regard to the other programs that they receive from 
other Federal agencies— for example, the Perkins funding— we 
need to coordinate more, and we need to plan together more up 
front. 

There is also an articulation between our secondary schools and 
colleges that needs to be part of this equation, too. In our county, 
we are looking at the "tech prep" program— in the last 2 years of 
high school and the first of college as being an opportunity to do 
this. 

But, from the JTPA standpoint, we are trying to inject the per- 
spective of those people who either are in danger of dropping out, 
in danger of being lost by the system, or who have already done 
so, and trying to bring them back in. That is the example that I 
think Bill was talking about with the State of Maryland's initia- 
tive. It is an example of the comprehensive program that is in the 
school system. 

Most of it is funded by State dollars, not JTPA. JTPA is a piece 
of this. But we are trying to identify people, work with them during 
the 4 years of high school and 1 year after, if that is the appro- 
priate transition,^ either to work or postsecondary education. 

Mr. Gerson. Td like to just follow up with one comment about 
your question because it is, I think, a good one. It was interesting 
to me to speak to 150 educators from our local school system re- 
cently, and to tell them about what we were doing in employment 
and training and to have them come ha,:k at me and say, "Our job 
is not to get these kids jobs or prepare them for jobs; our job is to 
educate them. Your job is to help them get jobs." 

There is a real debate going on about whether or not, indeed, the 
iob of schools is to educate or to prepare them for jobs. Not every- 
body is on board, thinking the same thing. 

Ms. Irving. I have to agree with that. That is what we are seeing 
also, that we educate for the sake of educating young people. The 
educational system doesn't really know if they are meeting the 
needs of the private sector or the corporations or not. They figure 
"Well, if we have been doin^ it for the last 20 years, why fix what 
is not broken?" Well, it is Droken. Inner cities are having major 
problems, far beyond anvthing you can ever imagine. That is why 
we try to support the school district as much as we can. We [PICJ 
can go in there— the schools— and make a difference by adding 
services. 

In terms of the colleges and universities, what I see is an ac^just- 
ment on their part to realize that they are not going to see the typ- 
ical academically prepared client; and they— colleges and univer- 
sities — have to shift tneir expectations down to reality. Then they 
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are going to have to work harder with us [PIC] to understand the 
harder-to-serve clients, , , , ^ 

We see ourselves in a pivotal spot where we can work with the 
universities and the school district to keep peace. 

X STOUEVER. Your question about higher education very ap- 
nroDriate since if we are working toward a high-wage high-skill, 
Kgh perforce work force out there, that higher education is 

'^Onf sp'ecifif ex'^^^^^^^ responds to the kind of issues that 

thSThSe mnlnto in Montgomery County. Life sciences is one of 
Himore's big dreams in terms of its economic future, and we s-e 
heS from the universities and research institutions and bu.i- 
nesfes there^is this big gap in terms of skilled lab technicians. 

So the Baltimore CHty Community College now has life sciences 
inst tSe that does lab technicians' training. Then they found thg 
they couldn't get kids out of city high schools that would quality 
to get into lab technicians training, so now we have tech prep in 
the hieh schools as a feeder to create a career path, now, in life 
sdencet of which higher education and .^^K-to-l^ system a^^^^^^^^^ 
JTPA system are all intimately entwined together in trying to 

"^Mr GerISn Xd''as different as Baltimore and Montgomery 
County, MD are, and to give some sense for how different commu- 

nities are , ^, 

Mr Stoukvkr. Yes, they have all the money. 

Mr Son Icontinuingl. We produce the money that goes to 

^tr^at p'foSm is one that is -mmon to our own community 
as well That's why I was talking about the high-tech firms^ that 
when we did the sirvey, told us they can't find entry level people 

'"mViStVrson. We have more questions we have to ask. Just one 
final comment. I represent a -ral area, and we have jus^ as big 
problems in our rural areas as you have in the inner city. We aont 
know exactly what to do with it all, either. 

We appreciate your being with us and your testimony was useful 
We mav submit a couple or three questions to you that I didn t get 
a chance to ask, if you would be willing to answer those, and we 
appreciate you taking the time. 

Ms Irving. Thank you for the opportunity. 

1- r™'rwVu?d like to call the last panel. We have David 
Wniiams who is the Deputy Assistant Secretary for Employment 
and Taining. He is accompanied by Karen Greene, chief of the Di- 
vSon ^Performance Management and Evaluation; Hugh Davies 
director Office of Employment & Training Pro-am; and Bryan 
Sr'admiSstrator of Office of Financial and Administrative 

""weToret the committee. Again, we swear everybody in, so if 
you don*t mind. 

K^Susor Th^^ you. Welcome to the subcommittee. 
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^'^^I^I^J^ ^- WILLIAMS. DEPUTY ASSISTANT SEC- 

RETARY, EMPLOYMENT /vND TRAINING ADMINISTRATION 
EI^!^^'^ ^^R' ACCOMPANIED BY klS 

DIVISION OF PERFORMANCE MANAGE- 
MENT AND EVALUATION; HUGH DAVIES, DIRECTOR, OFFICE 
OF EMPLOYMENT AND TRAINING PROGRAM; BRYAN KE^TY 
ADMINISTRATOR, OFFICE OF FINANCML AND ADMINISTRA- 

^ PATRICLV WILKINSON, GRANTS 
MANAGEMENT SPECULIST, OFFICE OF GRANTS AND CON- 
TRACT MANAGEMENT ainu coin- 

. Mr. Williams. Thank you, Mr. Chairman. I would like to take 
just a moment tx) also introduce to you Ms. Pat Wilkinson, who is 
Mr^dfty ""^^ Contract Management, to the lea of 

fi,^'";^^f ^^^.u^l^^^" overseeing our provisions of the amendments 
that deal with the contracts, management, budget and some of the 
reporting issues. 

Mr. Hugh Davies has spearheaded our effort on the amendments 
process and Karen Greene has been primarily responsible for our 
evaluation, research, and reporting initiatives, particularly with re- 
gard to the amendments. 

If I may, Mr. Chairman, I would like to go ahead and simply 
record^'"'^^ statement, and submit the full statement for the 

Mr. Peterson. That will be fine. 

Mr. Williams. I am pleased at this opportunity to appear at the 
tTh?t^ A^p^""^ effectively the Job Training Partnership 

•1 P':°P'3m IS serving disadvantaged adults and youth. I 

will address the subjects briefly listed in your letter of invitation 
beginning with the present status and operations of the JTPA title 
11-A program. 

Title II-A of JTPA is the largest Federal program aimed at pro- 

Jll^f .^'■^'T^J?'" ^.^^ P°°'"- ^1-7 billion is presently allotted to 
the 50 States, the District of Columbia, and the territories, and 640 
local service delivery areas to provide job training to economically 
disadvantaged individuals. From 1983, when the II-A program 
thjough June 1992, programs have served over 6 million 
adults and youth. 

JTPA program structure: The program is administered through 
tormula grants to States which, in turn, presently allocate 78 per- 
cent of the funds by formula to local service delivery areas Gov- 
ernors have the basic responsibility for program oversight and set- 
ting administrative standards. e u set 

Local programs are planned and monitored by the private indus- 
try councils. They are selected by locally elected officials and they 
are composed of a majority of local businessmen and business- 
women. 

A State job training coordination council— which includes reo- 
resentatives of business State officials, labor, and community orga- 
nizations, as well as others, for example, from health and welfare 
areas— advises the Governors on job training policy 

There are an estimated 16,000 service delivery staff persons na- 
tionally and an estimated 2,500 State JTPA staff persons 
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With regard to local program activities, they provide classroom 
training, on-the-job training, basic skills instruction, counseling, job 
search assistance, and supportive services* From 1983 to 1992, over 
3.5 million participants were placed in employment. 

Nearly 70 percent of the adult terminees are placed in jobs and 
74 percent of the youth terminees achieve positive terminations. It 
may be increased basic skills, it may be a return to school, or other 
positive outcomes. 

These are program year 1991 figures. At present, participants on 
average were enrolled in the program for 26 weeks. I believe there 
was testimony earlier indicating about 18 weeks. I believe that pe- 
riod has been extended and the period of time remaining in the 
program has been lengthened. Likewise, the earnings for adults 
placed has moved up to $6.08 an hour from the previous figure of 
about $5.85. 

Over 60 percent of the adults were employed 3 months after leav- 
ing the program. Minorities make up more than half of the pro- 
gram's participants; and nearly one-third were members of families 
on welfare. 

All local programs are operated under performance standards 
specified by the Secretaiy and set for each of the service delivery 
areas by the Governor. Current standards include adult earnings, 
job retention, and youth positive termination rates, such as return 
to school or obtaining new skills. 

Job training reform amendments: Over a period of the last 4 
years. Congress has deliberated, with the involvement of certainly 
the career staff, the GAO, the inspector general's office, as well as 
others, to enact the Job Training Reform Amendments of 1992. I 
will comment briefly on the impact of the amendments. 

We believe they will make significant changes in title II-A. 
While keeping prior aspects of the program involving private sector 
involvement, a performance-driven system, local planning, the 
amendments make some significant improvements, we believe. 

First of all, we realize that the program needed more targeting. 
Therefore, we believe we will be serving more of those most in 
need, in Doth adult and youth programs. All of these people are 
economically disadvantaged but, under the amendments, 65 per- 
cent of those served must have other barriers to employment. 

We are going to continue to provide client-centered training. 
With regard to that, the amendments increase those requirements 
by requiring a comprehensive assessment and individual service 
strategy. You heard comments on that earlier. I think clearly that 
is what the amendments drive the system to do, to assess and pro- 
vide individual service planning strategies. 

Those needing only job search— and we talked about that earher 
in the day — will be directed to other resources, such as the local 
employment service offices, for placement. 

Enhancing the coordination of JTPA with other service delivery 
activities and other human resources activities is clearly a thrust 
of the amendments. At the State level, there is a new human re- 
sources investment council authorized, providing the opportunity 
for Governors to combine planning and policy direction. 

There are new administrative requirements. All costs must be as- 
signed to the appropriate cost categories. There are new provisions 
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for financial management. Specific concerns are addressed, with re- 
gard to selected aspects of program operations such as limits on 
program income, the use of any excess income or so-called profits, 
and in the operation of the on-the-job training program. 

There is a new standardized program information reporting, or 
SPIR, system, which was developed in conjunction with the job 
training amendments, which will put into place a new client level 
reporting system for all terminees. We believe that is a unique re- 
quirement amongst Federal programs. 

With regard to implementation of the amendments, rulemaking 
was begun, even before the amendments were enacted in Septem- 
ber 1992. Tl.i Department published an advance notice of rule- 
making in the "Federal Register" September 10 and proceeded 
througn the rulemaking process with regard to the interim final 
rule, which was signed and issued on December 17, 1992, and was 
published in the "Federal Register" for comments on December 29, 
1992. 

These are interim final rules to allow the system to operate. 
However, we are now in the process of reviewing the comments 
that have been received before issuing a final rule. There have 
been more than 400 comments received. It will probably require 
that we take until September 1 to review and issue a final rule. 

With regard to training, we have provided a comprehensive, 4- 
day training course to the system. We did that in February and 
March of this year. Prior to that, we had also provided extensive 
training on procurement throughout the country to the system, 
both State and service delivery levels. The States in turn, right 
now are training staff in their local service delivery areas. 

A transition schedule and instructions have been issued with 
specific guidelines indicating how we transition from the old to the 
new system, covering such things as assessment and also the use 
of funds during the transition period. 

I will talk a little about the effectiveness of the JTPA title II- 
A program with regard to the studies that were discussed earlier. 

I think it is important to keep in mind that both studies were 
conducted prior to the 1992 amendments. We believe that, as Mr. 
Orr testified earlier, the national JTPA study was a definitive and 
scientific one. There will be additional information coming from 
that study — reported information now is up to 18 months. There 
will be a 30-month report and there will also be some additional 
information, I believe, on cost effectiveness. 

The national study involved more than 20,000 JTPA applicants 
in 16 SDA's. It followed up on such outcomes as employment, earn- 
ings, and educational attainment. At the 18-month followup, as 
was previously indicated, results showed positive, modest impacts 
for both adult women and men. It showed negative results for 
younger people, in particular for young males. 

It aid mdicate that there was some progress in terms of achiev- 
ing a GEO for adults who entered the program, as high school 
dropouts. For adult women, who were high school dropouts when 
they applied to JTPA, 19 percent of participants versus 11 percent 
of controls achieved a GED during the 18-month followup period. 
For adult men who were high school dropouts, 13 percent of par- 
ticipants were 7 percent of controls achieved a GED during the 18- 
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month period. The study found that earnings gains were 7 percent 
for adult women and 5 percent for adult men over the control 
group. 

The results of the national study for vouth were generally dis- 
appointing. On the positive side, the study found that the program 
almost doubled the rate of attaining a GED— from 17 to 29 percent 
for female youth and from 14 to 24 percent for male youth. 

However, the study also found no net effect on earnings at 18 
months for female out-of-school youth and actually negative effects 
for earnings of out-of-school male youth. The negative results, as 
previously indicated, were for those with prior arrest records. 

The national study's findings are useful when viewed in combina- 
tion with other net impact evaluations, such as JOBSTART and 
GET, which are described in more detail in the full statement. 

A multiyear evaluation of the Job Corps, funded by the Depart- 
ment and completed in 1982, did find a positive benefit-cost ratio 
of $1.46 for every $1 spent for the program from society's point of 
view. It found post-program gains in earnings of about 15 percent. 

I should indicate that the amendments envision that both the 
full assessment and individual service strategies that have been 
used successfully in the Job Corps Program will now be required 
of the JTPA title II-A program in general. There will be a new net 
impact evaluation of the Job Corps performed shortly and that, in 
fact, should give us more information on that part of the overall 
employment and training situation. 

I think it is fair to say that, while we have some demonstration 
projects which have given us information on how better to serve 
disadvantaged youth, we are still trying to find ways to improve 
the program. We are looking at our own demonstration projects; at 
the experience of the Job Corps. The experiments in some of these 
programs, such as JOBSTART and the CET program in San Jose, 
CA, as well as the STEP Program, help us to gain more informa- 
tion on how to more effectively serve youth. 

I would say, with regard to the San Jose program, that one thing 
that we did find was that the use of basic skills training as well 
as academic enrichment, as well as positive role models in that pro- 
gram, have shown significant earnings gains for young people. So 
this is one area in which we are continuing to follow a program and 
hope we can replicate it in some other locations. 

The General Accounting Office and the Department of Labor's 
Office of the Inspector General have examined the effectiveness of 
JTPA, You heard from them earlier. With regard to the inspector 
general's report, we believe that it corroborates many of the 
changes and the need for changes that were included in the 1992 
amendments and with which we in the Department worked very 
closely with the inspector general's office, as well as members of 
Congress and their staffs over a significant period of time in the 
last 3 or 4 years, to implement the 1992 amendments. 

With regard to the future of the JTPA program, it is clear that 
JTPA needs to be more closely coordinated. We will talk a little 
about some of the things that we are doing, perhaps, in the ques- 
tion and answer period. /. n i. « j 
The Secretary is currently undertaking a review of all the Fed- 
eral job training programs, including JTPA, to determine what pro- 
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grams and strategies work and those which do not. Clearly, we will 
continue to put more emphasis on those programs that work and 
reduce those that have proven not to work. 

I think it is also important that we continue to work with the 
other agencies who have these programs. Again, we can talk a little 
more about that. We have some interagency agreements. We have 
some task force eroups that are working on common definitions 
and on common plans for delivering services. We will be glad to ac- 
cept your suggestions, and work with this committee on ways to 
improve these programs. 

This concludes my prepared statement. I will be pleased to an- 
swer any questions, Mr. Chairman. Thank you. 

[The prepared statement of Mr. Williams follows:] 
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STATBMSMT OF 
DAVID O. WILLIAMS 
DEPUTY A88I8TAMT 8ECRBTARY 
EMPLOYMENT AND TRAININQ ADMINI8TRATI0N 
0.8. DEPARTMENT OT LABOR 



Mr. Chairman and Members of the Subcommittee: 

I am pleased to have this opportunity to appear at this 
oversight hearing on how effectively Job Training Partnership Act 
Title II-A programs are serving disadvantaged adults and youth. 
I will briefly address the subjects listed in your letter of 
invitation, beginning with the present status and operation of 
JTPA Title II-A programs. 

The Job Training Partnership Act (JTPA) was enacted in 1982. 
Title II-A of JTPA is the largest federal initiative aimed at 
providing job training for the poor. $1.7 billion is presently 
cul lotted to the 50 States, the District of Columbia, and the 
territories, and 640 local service delivery areas (SDAs) to 
provide job training to economically disadvantaged individuals. 
From 1983, when JTPA Title II-A began operations, through June of 
1992, local Title II-A programs have served over 6 million adults 
and youth. 

JTPA Program Structure 




The JTPA Title II-A program is administered through formula 
grants to States, which in turn presently allocate 78% of the 
funds by formula to local service delivery areas. Governors use 
the balance (22%) for administration (5%) , education coordination 
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activities (8%), older worker programs (3%), and performance 
incentives and technical assistance (6%) . Governors have the 
basic responsibility for program oversight and setting 
administrative standards for the program. Local programs are 
planned and monitored by Private Industry Councils (PICs) which 
are selected by local elected officials and made up of a majority 
of local businessmen and women. Nearly 8,000 businessmen and 
women serve on PICs. A State Job Training Coordination Council, 
which includes representatives of business, State officials, 
labor and community organizations, and others, advises the 
Governor on job training policy. 

The average SDA staff size is 25, and there are an estimated 
16,000 SDA staff persons nationally. Seventy percent of SDA 
staff earned less than $25,000 in 1987. The average State staff 
for JTPA programs is 44, and there are an estimated 2,500 State 
JTPA staff persons nationally. A majority of both State and SDA 
staff have substantial experience in theiv current position and 
within the employment and training field. 
Local Program Activities 

Local programs provide classroom training, on-the-job 
training, basic skills instruction, counseling, job search 
assistance and supportive services to participants. From 1983 to 
1992, over 3.5 million participants were placed in employment. 
Nearly 70% of the adult terminees are placed in jobs and 74% of 
the youth terminees achieve positive terminations -- placement in 
jobs, return to school, further training, etc. For the most 
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recent year of operation (July 1, 1991 - June 30, 1992), 
participants on average were enrolled in the program for 26 
weeks. Adults were placed in jobs with an average wage of $6.08 
per hour, with over 60 \ of them employed three months after 
leaving the program. Minorities made up more than half of the 
program's participants, and nearly one-third were members of 
families on welfare. 
A Performance Driven System 

All local JTPA programs are operated under performance 
standards which are specified by the Secretary of Labor and set 
for each service delivery area by the Governor. Current 
standards include adult earnings and job retention rates and 
youth positive termination rates. If local areas exceed the 
standards, they receive from the Governor a proportionate share 
of incentive funds. If they fail to meet the standards, they 
receive technical assistance to improve performance, or if they 
fail for two consecutive years sanctions are applied. 
The Job Training Reform Amendmen ts of 1992 

Your letter asked me to discuss the anticipated impact of 
the 1992 amendments to the Ac^, as well as a report on the status 
of the Department's implementation of the amendments. 
The Basis for the Amendments 

As early as 1987, certain issues arose regarding the 
operation of JTPA, and in particular Title II-A: 

o Was the program serving those eligible participants who 
were most in need, or was the program serving those 
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most readily placeable? 

o What was the quality and sufficiency of the training 
and services provided by JTPA? 

o Was the arrangement for program administration, largely 
delegated to the Governors, working acceptably? 

The discussion of these issues formed the basis for a major 
policy debate on JTPA. An Advisory Committee was commissioned to 
make recommendations on the redirection of JTPA. The General 
Accounting Office and the Department's Office of the Inspector 
General also provided critical review of these issues. Over a 
period of four years. Congress considered legislation to revise 
JTPA. The culmination of these efforts was the enactment of the 
Job Training Reform Amendments of 1992. 
The Impact of the Amendment s 

The Amendments will make significant changes in the quality, 
delivery, and administration of programs under JTPA Title II-A. 
While keeping the aspects of the program which have been the 
cornerstones of JTPA, such as private sector involvement, a 
performance driven system, and local planning, the Amendments 
will make major improvements in the following areas: 

1) Reaching those most in need - Both adult and youth 
programs roust still serve individuals who are econoi:.ically 
disadvantaged, but now 65% of those served must have other 
barriers to employment, such as being a welfare recipient, basic 
skills deficient, a school dropout, a person with disabilities, 
an offender, or homeless. This will ensure that JTPA services 
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are targeted to those who are most in need and can benefit from 
job training. 

2) Providing client centered training - All participants 
must receive a comprehensive assessment of their skill levels and 
service needs, and have an individual service strategy based on 
the assessment. Local programs must provide an array of training 
and services which will respond to the needs of the participants. 
It is expected that only those participants needing job training 
will be enrolled. Those needing only job search will be directed 
to other resources in the community. At least half of the funds 
going to local communities must be spent for training, and up to 
30 percent of the funds may be spent for supportive services or 
training related expenses. No more than 20 percent may be spent 
for administration. This revamping of the basic service design 
in JTPA II-A is expected to substantially improve the quality of 
training and the overall performance and impact of the program. 

3) E nhancing the coordination of JTPA with other human 
service activities - The Amendments provide for greater 
coordination of JTPA with other human service programs in local 
communities and at the State level - such as JOBS, Vocational 
Education, Adult Basic Education, and others. New requirements 
emphasize coordination in local planning. New arrangements are 
established for education coordination activities. A new State 
level human resource investment council is authorized, providing 
the opportunity for Governors to combine th« planning and policy 
direction of several human service programs administered at the 
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State level. Over 20 states are expected to establish such 
councils . 

4) New administrative arrangements are required ~ The 
administrative concerns identified in JTPA are addressed in the 
Amendments. The Secretary will specify th« basic procurement 
provisions which must be included in all Governor's policies. 
All costs must be assigned to the appropriate cost categories. 
New provisions for financial management are to be applied. 
Specific concerns with selected aspects of program operation are 
addressed - such as limits on program income, profits^ and the 
operation of on-the-job training programs. ETA has taken action 
on certain of these arezis already. Systemwide monitoring of 
procurement and on-the-job training has already occurred, and 
where deficiencies have been identified, corrective action has 
been taken. 

5) Standardized Prog ram Information Reporting - A new 
Standardized Procrram Information Reporting (SPIR) system, which 
was developed in conjunction with the Job Training Reform 
Amendments, will put in place a new client-level data system for 
JTPA that is unique aaong Federal programs. This new system, 
which becomes ef^fective this July, will provide comprehensive 
data on all JTPA clients — their characteristics, the services 
they receive, and outcomes — that can be used by policymakers 
and managers at the Federal, state, and local levels. 
Implementing the Amend—nts 

1) R ulemaking - The Job Training Reform Amendments were 



2''4 



201 



7 



enacted on September 7, 199 2. The Department published an advance 
notice of proposed rulemaking in the Federal Register on 
September 10 requesting comments on the principal issues 
anticipated in rulemaking and implementation. The comments 
received and the active collaboration of ETA with system 
representatives and staff of the Office of the Inspector General 
formed the basis for the Interim Final Rule signed on December 
17, 1992 and published in the Federal Registe r on December 29. 
To date over 400 comments have been received on the rule. In 
order to carefully analyze this large volume of comments, the 
Department has delayed the publication date of the final rule 
from June 1 until September 1. 

2) Training ' The Department provided comprehensive, four- 
day training sessions on Amendment and regulatory requirements to 
a core group of state officials in February and March of 1993. 
The States, in turn, are training staff of their local service 
delivery areas. The Department is also providing further 
specific training during the next six months on key aspects of 
the amendnents such as assessment, youth service strategies, and 
financial management. All training is being undertaken with the 
support and collaboration the OIG and other Department agencies. 

3) Transition Sch<dulc and Instructions - ETA has issued 
specific guidelines to the JTPA system which provide information 
on the transition from the old program requirements to those 
required in the Amendments. The effective date is July 1, 1993. 
Guidance has been provided on the application of new 
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requirements, including the use of carry- in funds and the phasing 
in of certain requirements during Program Year (PV) 1993 (the one 
year period following July 1, 1993). All administrative rules 
are to take effect July 1. Certain program design areas are to 
be phased in during PY 9 3 in order to ensure their erfective 
implementation. These include new assessment systems and out-of- 
school youth service requirements. 
Effectiveness of JTPA Title II-A 

Mr. Chairman, next I will discuss the effectiveness of JTPA 
Title II-A programs. Please keep in mind that each of the 
studies I will refer to was of the JTPA program prior to the 1992 
amendments. While there have been many studies and evaluations 
of JTPA, we believe the most definitive and scientific is our 
National JTPA study. This net impact evaluation is a random 
assignment study. Preogram applicants are divided into treatment 
and control groups through a lottery. Control groups are denied 
job training services from the particular program under study to 
establish what would happen in the absence of the program. The 
National JTPA Study randomly assigned 20,000 JTPA applicants in 
16 SDAs to treatment and control groups over the period November 
1987 through September 1989. However, it should be noted that 
the SDAs themselves were not randomly selected and are not 
necessarily representative of all SDAs. Individuals in the 
treatment and control group are followed up over time to 
determine if the training had an impact on post-program outcomes 
such as employment, earnings, and educational attainment. The 
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measurement of the difference in employment and earnings between 
the treatment and control groups is the net impact. 

At eighteen months followup, the study found positive but 
generally modest net impacts for adults. On average, compared to 
controls, the program nearly doubled the rate of attaining a GED 
for adults who entered the program as school dropouts--f rom 11 to 
19 percent fee women and from 7 to 13 percent for men. The study 
also found earnings gains over controls of 7 percent for adult 
women assigned to the program and 5 percent for adult men 
assignees during the 18-month period following random assignment. 
Earnings gains for women were found in both classroom training 
and on-the-job training (OJT) , while gains for men were 
concentrated in OJT. These positive gains appear to be holding 
steady over time, and will be re-examined at 30 months follow-up. 

The study also looked at the issue of whether training was 
more effective for the most job-ready or least job-ready. It 
found that, for adults, the most job-ready had the best results, 
which suggests the need for more comprehensive interventions for 
the least job-ready. 

These findings for adults are consistent with the major 
studies of welfare-to-work programs, which have found modest but 
positive gains for adults. 

The results of the National JTPA Study for youth were 
generally disappointing. On the positive side, the study found 
that the program almost doubled the rate of attaining a GED for 
youth who entered the program as school dropouts — from 17 to 29 
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percent for female youth and from 14 to 24 percent for male 
youth. However, the study also found no net effect on earnings 
IB-months after random assignment for female out-of-school youth 
and negative net effects on earnings for out-of-school male 
youth. The negative results for male youth were concentrated 
among those with prior arrest records (25 percent of the sample), 
but even for male youth without records the program did not 
achieve positive impacts. 

Many of the National Study's findings are corroborated by 
other net impact evaluations of particular programs and models. 
For example, a JOBSTART demonstration funded in part by the 
Department of Labor attempted to provide a fairly comprehensive 
set of basic skills and vocational skills to dropout youth with 
low reading skills. The evaluation has found positive impacts on 
achieving a GED. However, the evaluation has found only modest 
net impacts on earnings for female youth, and negative impacts 
for male youth during the first two years of follow-up balanced 
by positive impacts during the third and fourth year of follow- 
up. The JOBSTART cumulative four-year results for males are 
still slightly negative, but the third and fourth ye^r gains 
suggest that early losses in earnings may be made up over time 
and that educational gains from the program may be beginning to 
have some effect. The JOBSTART results are particularly 
important because the demonstration in many ways reflects the 
direction in which DOL and Congress has been pushing JTPA — 
towards more comprehensive services to more at-risk persons. 
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One JOBSTART site — the GET program in San Jose, California 
— had very positive results. This same program also had very 
positive earnings gains in a separate demonstration aimed at 
minority female single parents. The GET program is quite 
structured and offers concurrent basic education and job 
training, with close interaction with case managers and 
instructors with extensive industry experience. 

A multi-year evaluation of the Job Gorps funded by the 
Department and completed in 1982 did find a positive benefit-cost 
ratio of $1.46 per $1 spent for the program from society's point 
of view. The study found post-program gains in earnings of about 
15 percent, but much of what tipped the scale in favor of a 
positive benefit-coct ratio were savings in criminal justice 
costs due to reduced serious crimes committed by participants — 
both while they were in the program and fewer serious crimes 
committed after they left. The study used a comparison group 
rather than a control group design. The Department is currently 
competing a net impact evaluation of the Job Gorps. 

Overall, these findings indicate that we do not yet have the 
answers for effectively serving disadvantaged youth. We are 
trying to work towards these answers. For example, we might be 
more successful if we caught youth earlier, before they left 
school — suggesting the need to better integrate our programs 
with the public schools, as we are proposing to do with our 
school-to-work transition initiati- e. This initiative will 
provide students with structured career paths and afford students 
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the opportunity to learn in "real world" contexts, such as 
worksites and communities, as well as classrooms. We also might 
be more successful with a tightly targeted geographic saturation 
of program alternatives, as we are doing in our Youth Fair Chance 
program. Peer pressure is perhaps the dominant force that acts 
on youth, and a saturation of programs may be necessary to 
reverse the negative peer pressure that in many cases now 
prevails among disadvantaged youth. 

The General Accounting Office (GAO) and the Dep.jrtment of 
Labor's Office of the Inspector General (OIG) also have examined 
the effectiveness of JTPA. Many of the findings of the GAO 
formed the basis for modifications to the current program that 
were included in the Job Training Reform Amendments of 1992. The 
recent OIG report on JTPA program outcomes in 35 Service Delivery 
Areas is useful in that it corroborates the need for many of the 
changes that were included in the 1992 Amendments. Like the 
other studies, however, the OIG report refers to the program 
prior to the implementation of the 1992 amendments. 

rhfi FutU TT'^ of JTPA 

Finally, Mr. Chainnan, you asked that I address a series of 
questions relating to the future of the JTPA program, such as 
whether JTPA should be integrated with other job training 
programs, how it fits into the Department's strategy for creating 
a competitive workforce, and how Federal job training funds can 
be best utilized. Secretary Reich is undertaking a review of 
Federal job training programs, including JTPA, to determine the 
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programs and strategies that work and those that don't. We need 
to put more of our reso^ /'^es into the former and phase out the 
approaches that are ineffective. You can be assured that the 
Department will be having many discussions with this 
Subcommittee, as well as the authorizing Committee, as our review 
progresses. We welcome your suggestions, as well as those of the 
GAO, the OIG, and others, for ways to improve our Nation's job 
training programs. 

Mr. Chairman, this concludes my prepared statement. At this 
time I would be pleased to answer any questions that you or other 
members of the Subcommittee may have. 
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Mr. Peterson. Thank you, Mr. Williams. Nobody has been ap- 
pointed over at your shop yet? 

Mr. Williams. Mr. Douglas David Ross's nomination has gone 
forward, sir, and we are waiting for that process to be completed. 

Mr. Reterson. He will be whatever the title is over your Depart- 
ment? 

Mr. Williams. Assistant Secretary for Employment and Train- 
ing, sir. 

Mr. Peterson. What do you say about the discussion that we 
had earlier about the fact that the IG said that they don't know, 
they can't measure these programs from some areas and they don't 
have the information? 

Mr. WlLLL\MS. Well, first of all, I would ask that Ms. Greene talk 
a little about what we do have in place. In particular, we have a 
performance measurement system that has been in place for some 
period of time which, in fact, drives this system in terms of incen- 
tive payments and awards that are made, recognition for exem- 
plary programs, and sets standards for the system which, in turn, 
are reviewed and set for each service delivery area. 

I would like you to talk first about that system a little, Karen, 
if you would, in terms of both providing information about the pro- 

fram and then driving the system in terms of performance in the 
irection to serve more of those who are hard to serve and includ- 
ing welfare recipients and others. 

Ms. Greene. I will just take a short period. We have six meas- 
ures that we use in order to assess program performance, and they 
are absolutely unique, as far as I know right now, to any Federal 
program. 

We look at whether individuals are employed and what their 
earnings are 13 weeks after they leave the program. We not only 
collect information on those participants while they are in the pro- 
gram but every person that you saw sitting at this table earlier has 
a responsibility to conduct telephone followups to find out if they 
are employed. 

We have a record of 61 percent of our adults still working 13 
weeks after they leave the program. Fifty percent of our welfare re- 
cipients still have jobs and are working 13 weeks after they leave 
the program. We ali5o collect information on the earnings of those 
individuals. 

For youth, because so many of those are in school and are not, 
perhaps, able to work, we collect information, as was mentioned in 
the previous testimony, about other factors that measure their em- 
ployability, their occupational and basic skill achievement; but 
these would be achievements short of a iob. 

We have been reviewing our standards, starting off early on with 
short-term standards. Because of some of the effects that perform- 
ance standards have had on the program, we have altered them pe- 
riodically and, right now, they are totally in sync with the depart- 
mental coals. 

I thinK one of the concerns that we have had in the Department 
is making sure that, as you set numerical goals and targets for pro- 
grams, that you don't create a situation where they're working so 
hard in order to make numbers to document their success that 
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they, in turn, lose sight of the clients that they are supposed to 
serve and the way they are serving them. 

So we have haa to make adjustments over time to do that so that 
we would avoid a preoccupation with serving more job ready and, 

Eerhaps, providing less effective less-intensive services in order to 
eep costs down; giving the appearance of efficiency at, perhaps, 
the sacrifice of our clients. 

So in terms of our performance management system, we are con- 
stantly reviewing it and constantly getting feedoack from the field 
on what the implications are of our performance management sys- 
tem on enrollment policies, service delivery, and other operational 
effects for our clients. 

Mr. Peterson. I wasn't probably clear enough, but what I want 
to know is, it says here, "Determining the total investment for each 
participant was impossible.'' Do you agree with that? 

Mr. Williams. I think, in part, the performance measures an- 
swer one part of that. I think the new standardized reporting sys- 
tem which will give individual client 

Mr. Peterson. We are not talking about performance here, we 
are talking about investment— dollars — from what I understand. 

Ml. Davies. Clearly, we have data on cost per entered employ- 
ment, so we know how much it costs to achieve the standard pro- 
gram outcome. 

Mr. PETEiiSON. Wliy does he say this? Why did he say determin- 
ing the total investment was impossible? 

Mr. Davies. I'm not sure, but I can assure you that we have spe- 
cific data on the expenditures in the program and how much it 
costs for each individual positive outcome. 

Mr. Peterson. What does that mean? For the no positive out- 
comes you don't have that, or what? 

Mr. Davies. We have full data on the outcomes for all the par- 
ticipants. We have full information on the expenditures in the pro- 
gram. 

Mr. Peterson. These SDA's and whoever they are, the States, 
they give you this information? 

Mr. Davies. That's right. We get the information reported from 
each of the service delivery areas and we get expenditure informa- 
tion from the States on the total expenditures in that State. 

Ms. Greene. I think one thing that we cannot do is we cannot 
measure the total costs that are involved in bringing a client up 
to a fully employable State. 

There was a reference made this morning that there is a lot of 
leveraging of resources. When you are serving a hard-to-serve cli- 
ent, you are perhaps pulling resources from vocational education, 
welfare, federally funaed programs like the JOBS programs. You 
could have State moneys; you can have local moneys. 

There are a lot of resources that go into running the programs. 
In the case of Baltimore for example, they ticked off a. numiber of 
partnerships and made reference to many, many service providers 
and funding resources contributing to the success of those clients 
who went through JTPA. 

We can do a fairly good job, I think, and are trying to work on 
tracking what the costs are for the total number of participants 
that go through the program. But to be able to find out how many 
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otWr resources contributed to that individual from these other 
sources is very difficult. 

Mr. Peterson. I can understand that. But it says here: "Finan- 
cial records were usually not maintained on a participant basis." 

Ms. Greene. They don't normally collect costs. They can't sepa- 
rate out costs by individual. 

Mr. Peterson. That's not true. I was at my CEP agency, and 
they absolutelv have this every single day. They have more stuff 
than you coula ever know what to do with. So why do they say that 
they were not maintained? Do you know? 

Ms. Greene. From my knowledge of the accounting systems at 
the local level, it is very difficult to be able to attribute specific 
costs for that individual if there is more than one funding source 
that is being used to serve that individual. 

Mr. Pt:TERSON. That's not true in the apency that is in my home 
town. 

Ms. GrkENIC. Some do, but I think in the sites — they were refer- 
ring to their experience in 35 sites. So I sense that in the 35 sites 
that they examined — they were not able to capture local costs 
through the records. 

Mr. Peterson. Do you guys look at that, or is that something 
you are trying to do something about, or is that what SPIR is 
about? 

Ms. Greene. The standardized program information is really just 
a participant-tracking system. 

Mr. Peterson. How does that work? 

Ms. Greene. How that will work is that 

Mr. Peterson. No. I want to know who is doing the software, 
what kind of machine is it going to run on, and where is it coming 
from. Is it something from up here that is being said the agency 
has to buy this software? How does it work? 

Ms. Greene. At this point, we do not have standardized soft- 
ware. What we are asking is that individual files would be trans- 
mitted to the States and then transmitted to an independent con- 
tractor. The contractor, then, will set up the national data base 
which will have 

Mr. Peterson. You are going to do this by July 1 and you don't 
know? 

Ms. Greene. Excuse me. We have the program. In fact, we had 
a demonstration 

Mr. Peterson. What program? 

Ms. Greene Icontinuingl. Of the 

Mr. Peterson. Some contractor did the program? 

Ms. Greene. We have a contractor — Meridian Corp., in Arling- 
ton, VA — that is our ADP contractor and they are setting it up. All 
of the coding specifications were sent out to the States already. The 
format was also sent out to the States. 

They wi^^ be sending data on disk or tape, in an ASCII file, so 
that we do not have to impose a specific software on States and lo- 
calities where they may have verv good software, very good pack- 
ages already that they're using. They [States I will be sending it up 
in a generic ASCII file and then, from there, we would convert it 
to reports. 
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Those reports will be national reports that we will use. We will 
also have State and local reports as well. But the data are collected 
at the local level and then transmitted upward in a machine-read- 
able format. 

Mr. Petcrson. So the local SDA is going to send up an ASCII 

file to the States 

Ms. Greenk. To the States. 

Mr. Pktei^on Icontinuingl. And the States are going to accumu- 
late them for their State? 

Ms. Greenk. That's correct. They would accumulate it for their 
State. We will have a file. We will get a tape from the State that 
will have a record of every individual in the JTPA program, in a 
yearly submission, a batch file. 

Mr. Peterson. So the State is going to take the local SDA's 
ASCII files and combine them and then send them to you? 

Ms. Greene. That's correct. 

Mr. Petorson. Why do you want to do that? Why don't you just 
take the ASCII file right ft ■)m the SDA? Wouldn't it be easier? 

Ms. Greene. Because it's a decentralized system, Mr. Chairman, 
and certain responsibilities are relegated to the State as well as the 
locals. It also is an opportunity for States to look at the data and 
be able to use the data if they are not already doing that. 

Mr. Peterson. So they are going to take the ASCII files and con- 
vert them into something at the State level, then they're going to 
turn and put it back into an ASCII file and send it to the Federal? 

Ms. Greene. Most States have their MIS system, for which they 
gather individual data. 

Mr. Peterson. And that is going to be different from what you 
are doing now? 

Ms. Greene. Every State, I suppose, has their own system and 
locals have their own systems. Each has its own MIS systern and 
its own means of gathering information. What we are doing is 
we've just standaroized the information, to make sure that it is 
standardized, which was a point that the IG's office made earlier, 
that there was a lack of standardization. 

We have n^w standardized about 55 pieces of information. We 
have uniformly defined them. We've sent the instructions out to the 
system. So now, the locals know what needs to be forwarded. The 
States have always had the responsibility of maintaining local files. 

Mr. Peterson. In other words, they are going to nave to do 
something with their software to accumulate these 55. 

Ms. Greene. That's correct. And we have a technical assistance 
ADP contractor that is working with the States right now that is 
providing guidance, technical assistance, and onsite visits. 

Mr. PETEitSON. They are working with the States? Are they 
working with the SDA's? 

Ms. Greene. The technical assistance contractor is federally 
funded. We've retained the contractor to work with the States and 
the SDA. 

Mr. Peterson. Who is the contractor? 

Ms. Greene. Meridian Corp. Subcontractors are Viar and Social 
Policy Research. It is a three-pronged effort to provide automated 
data processing, technical assistance, reporting, analysis. It is a 
complete package. 
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Mr. Peterson. And this is going to be done by July 1? 

Ms. Greene. It's already — we had a meeting this week. We had 
representatives from 15 States and about 10 localities, representing 
every region of the country. We did a status report. We did an as- 
sessment and needs survey about 6 months ago, and we are pretty 
confident, with the exception of four States, that they will be up 
and running; and in those four States we are sending the contrac- 
tor out onsite to guarantee that this will be up and running by July 
1. 

Mr. Peterson. What is this going to cost? 

Ms. Greene. For developmental costs and all the technical as- 
sistance that's involved in the site visits, it is slightly over $1 mil- 
lion for the first 20 months. The cost should be reduced substan- 
tially after the initial 20 months, once the system is up and run- 
ning. 

Mr. Peterson. That's for software development, mostly 

Ms. Greene. That's right. 

Mr. Peterson [continuing]. Training? 

Ms. Greene. They will be developing peripheral software, which 
will be made available to States and localities. However, we did not 
want to standardize that if States felt that they could more easily 
extract from their existing systems the information we wanted. 

Mr. Peterson. So is the software — I mean, some people are run- 
ning on AS-400's and some are running, I suppose, on PCs, and 
some are running on mainstreams? 

Ms. Greene. We've done an assessment to find out the hard- 
ware. 

Mr. Peterson. So they're going to provide the software and all 
these different formats? Is that the deal? 

Ms. Greene. That's true. But we have conversion packages. The 
other thing that I need to explain to you is that we do have a fund- 
ing source — it's called a 6 percent setaside — at States' disposal for 
technical assistance. 

In anticipation of, perhaps, some of the MIS changes tnat would 
be needed to implement this standardized system, we gave them, 
during this transition period, the opportunity to use some of that 
money to make their systems compatible if they needed to. That is 
being done right now, and that is probably the reason why most 
of the States now feel that they will be in a position where they 
can comply with this new system. 

Mr. Peterson. Is everybody going to be in agreement on the 
kinds of things that you are accumulating? When I sit around and 
listen to all these different people, I hear them arguing amongst 
themselves about whether you're accumulating the right thing or 
not, or whether you can't really rely on this because you made 
some judgment that this is how it should work. 

Has that been resolved, or are we going to have people arguing 
when we get all this accumulated, arguing that we accumulated 
the wrong thing and it does not mean anything? 

Ms. Greene. We have had an elaborate process of developing 
this particular record, and we started it back in October 1991. we 
have had a series of technical work groups, "Federal Register" no- 
tices, and solicited comments on the information we are collecting. 
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We are certainly within, I think, the JTPA community, in agree- 
ment that what we are collecting probably the most complete infor- 
mation and will address all of the issues. 

Mr. Peterson. Will the IG agree with that? 

Ms. Greene. Let me just explain. The one issue that I must say 
we have not been able to address in this is the accumulation of 
AFDC data pre- and post-program. 

That particular area is an area — probably the only area, to my 
knowledge, that I know — where there would be any disagreement 
between the IG and the Department of Labor, because the IG 
worked very closely with us in the development of this instrument. 
They were a part of every technical work group. They responded 
to our public comment process. And we met with the IG before it 
was developed. 

So we have worked with the IG. The one area where we were un- 
able to comply, I think, with what they would like, is to require 
that every record have AFDC grant amounts, and that we look at 
pre- and post-grant allotments. The reason why we did not do that 
is because it is an extremely costly process right now to accumulate 
that kind of information. 

We are dealing with over 1 million JTPA participants. That 
would mean attachment of AFDC records of nearly 40 or 50 per- 
cent of those participants. In many States — we polled the States — 
they said that they aid not have the formalized arrangements that 
would be necessary in order to access individual AFDC files. They 
do it at the local level in some areas, but it is not a typical situa- 
tion. It would be costly. 

Also, our reporting system is subject to the Office of Management 
and Budget review process. We are under a paperwork reduction 
authority. Every one of our data collection surveys must be re- 
viewed by the Office of Management and Budget. 

We have had difficulty in the past getting approval from that 
particular office in the quantity of data, because of the reporting 
burden that it would place on the system. That is the reason why 
we go through an elaborate public comment process. 

I think that if we were to ask the system — and we did, in a work 
group, pose the question before 20 State people and about 20 
locals — Would you be able to accumulate the desirable AFDC 
records so we could get grant amounts?" We were told that it would 
be extremely burdensome, very costly, and they would oppose it in 
the public comment process. 

Mr. Williams. Is tnat for reasons of confidentiality? 

Ms. Greene. Confidentiality was an overriding issue, because it 
would have client information. It could have also case numbers and 
Social Security numbers on it, wb^ch were confidential. 

Mr. Peterson. Could you provide to the committee, for the 
record, the specifics of this program? The 55, whatever it is? 

Mr. WILLIAMS. Yes, sir. 

Ms. Greene. Sure. 

Mr. Peterson. And the contract, and just what you're up to with 
this whole thing, so we can understand it better? 
Mr. Williams. Yes, sir. 

Mr. Peterson. The second panel that we had today was con- 
cerned that what we did with the 1992 amendments was going to 
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take away flexibility at the local level, and it may be counter- 
productive to dealing with the local needs. How do you re&pond to 
that? 

Mr. Davies. The JTPA system, when enacted in 1982, provided 
broad flexibility on the kinds of interventions that could be pro- 
vided for any individual. After a period of operation, the view 
was — and everything that we heard from our experts in the first 
panel this morning was — that limited interventions had limited im- 
pact. 

The view of the community and the authorizing committees and 
the Department was, we had to restructure JTPA in a manner that 
it ensured a more intensive, more targeted individual intervention. 
That is essentially what we have done. 

Certainly, some people would be of the view that that was unnec- 
essary, that the local community, the local planners, have a better 
view of that and should be given full flexibility in whatever serv- 
ices, whether it be just job search alone, as the activity in JTPA. 
Our view was that we had to provide ereater specificity in terms 
of the intervention, and that is essentially what we provided. 

By and large, though^ the system buys into that notion now and, 
certainly, while there is some exception to that even among the 
witnesses today, I think, by and large, the system agrees that an 
ensured comprehensive intervention for all paT-ic-pants in the pro- 
gram is the most appropriate strategy. 

Mr. Peterson. There have been some people thai iiave criticized 
the ABT study because they didn't think it included everybody it 
should have, or whatever. Is this new SPIR deal, is that going to 
eliminate the need for doing these kinds of studies? 

I mean, are we going to have all this information, now, and is 
it going to be absoTutely accurate and everybody is going to agree 
cn it? 

Ms. Greene. Nothing satisfies everybody. I would say that the 
SPIR will bring our agency and our program probably to a point 
where we have more information on what services seem to work for 
certain subgroups in the population, and outcomes — what we call 
outcomes, or successes, ii you want to call it that — are a better 
measure of our ability to place people and wages for people who are 
in different target groups. 

In terms of oeing able to, I think, eliminate the need for re- 
search, no management information system can eliminate the need 
for research. You need to go onsite. You need to look at the context 
in which these people are oeing served and the local labor market. 

You need to talk to the people who are staffing programs. You 
need to know more about the d>rnamics of the programs. So there 
will always be a need for continuing research. 

The management information system gives you a glimpse, but 
you really have to, in order to see which are the most eflective pro- 
grams, you have to have what we would call more process and, 
also, more of the experimental kinds of research that were de- 
scribed this morning. 

An MIS system cannot answer the question, "What would hap- 
pen in the absence of the program?" 

Mr. Peterson. Right. Do you do that? I mean, do you have peo- 
ple in the Department that go out and do this? 



218 



215 



Ms. Greene. No, we fund almost all of our research to outside 
contractors who do the field work. 

Mr. Peterson. Why do you do that? 

Ms. Greene. We do it competitively. 

Mr. Peterson. Why do you do that? 

Ms. Greene. Why would we fund contractors? 

Mr. Peterson, why don't you do it yourselves? 

Ms. Greene. Because of staffinf limitations. We have five indi- 
viduals who are responsible for our research and evaluation. They 
constitute our research and evaluation staff for the agency. 

Mr. Peterson. Five people? 

Ms. Greene. Five people 

Mr. Peterson. Have you asked for more people? 

Ms. Greene [continuing]. In our research and our evaluation. 

Mr. Peterson. Have you asked for additional positions? 

Ms. Greene. In the past, I think we have. 

Mr. Davies. Individual offices always ask for more staff. 

Mr. Peterson. I'm not talking about staff. Tm talking about this 
specific function. Have you asked? 

Ms. Greene. For research and evaluation, I think we always go 
in with a request for more. 

Mr. Peterson. How many more? For 10 instead of 5, or what? 

Ms. Greene. Given the fact that we have, at times, had dem- 
onstrations that we have been responsible for, we have gone in 
probably with requests for considerably more than what we have 
right now. But the reality of the situation is that we are in a mode 
of cutting back; weVe not in a mode of expanding. Research and 
evaluation is usually the first thing to go when you are in a mode 
of cutting back on Federal resources. 

Mr. Peterson. I guess in the 1992 amendments, they changed 
these percentages where they used to be 70, 15, and 15? 

Mr. Williams. Cost limitations, yes, sir. 

Mr. Peterson. And now the administrative are 20 percent? 

Mr. Davies. Yes, sir. 

Mr. Peterson. Do you think that is kind of arbitrary, or do you 
think that is some kind of magic number? 

Mr. Davies. We spent considerable time looking at the actual 
costs in the system. There is tremendous variability in terms of the 
size of service delivery areas in the system and, obviously, the 
amount of the administrative costs is going to vary in terms of 
economy of scale. It is easier for New York City to operate on 20 
percent than it may be for a much smaller service delivery area. 

We felt though that, on balance, the 20 percent administrative 
cost limitation was fair and that the program could be properly ad- 
ministered within that limit. 

Mr. Peterson. It was 15 before? 

Mr. WlLLL\MS. Yes, sir. It was 15 before. 

Mr. I^terson. And that was not adequate? 

Mr. Davies. Part of the problem that we dealt with in the 
amendments was to get a better handle on where the expenditures 
were going in JTPA. The method of accounting for costs in the sys- 
tem was such that it was hard to get a handle on how much ad- 
ministrative costs there really was in the system. 

Mr. Peterson. Do you have a handle now? 
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Mr. Davies. Yes. The amendments provide for a much more ex- 
plicit set of requirements for how costs are accounted for in the 
JTPA system. 

Mr. Peterson. But they have not been implemented yet. 

Mr. Davbes. They will be implemented on July 1. 

Mr. Peterson. So you think that you will have this information, 
but we don't know at this point? 

Mr. Davbes. I know that in working with the inspector general's 
office and the other people that have a concern about this, that 
we've set up systems that should ensure that costs are properly ac- 
counted for. 

Mr. Peterson. How would you track this? Through the audit re- 
ports *hat come in? Is that how you track this? 

M , Davies. The costs will be tracked both within the reporting 
system and in the audit reports. 

Mr. Peterson. So when these audits come in from these 600- 
and-some agencies, you have somebody in your shop that accumu- 
lates all this? Is that how it works? 

Mr. Davies. The audit process — and it is unfortunate that our 
OIG colleagues are not following us rather than us following 
them — the audit activity is the — in fact, I'll ask Bryan, who han- 
dles that 

Mr. Peterson. Well, when I use to do audits, I used to send all 
these copies to the Department of Labor in Chicago, I think. I used 
to have to send 10 audits. I never could figure out what we were 
up to. It said in this book we were supposed to send them there, 
so we did. I often wondered whatever happened with them. 

Mr. Williams. The process works this way. The IG contracts or 
performs the audits. The audits then come to the program agenc>^ 

Mr. Peterson. Then the IG doesn't perform the audits; the local 
auditors perform the audits. 

Mr. Williams. There are two different kinds. 

Mr. Peterson. Isn't that where you get the information? 

Mr. Williams. Generally, audits performed at the local level, 
then, are rolled up to the State level. They are reviewed at the 
State level for questioned costs and for disallowed costs, and then 
they are, in turn, reviewed by the national staff here to see if there 
is agreement with the action taken. 

Mr. Peterson. When you say reviewed, you basically look at the 
last page and see if there are any questioned costs? 

Mr. WiLLLVMS. No. 

Mr. Peterson. Do you actually look at the whole report? 
[Mr. Williams nods.] 

Mr. Peterson. How many people do you have doing that? 

Mr. Keilty. We have in our audit resolution and closeout and 
debt management staff, I would imagine, about 30 people. 

Mr. Peterson. And they are able to do that? And then you put 
all of this into some data base or something, or how does that 
work? 

Mr. Keilty. We have a data base that tracks these audits when 
they come in, where they are, what state of the process we are in, 
resolution. 
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Mr. IjTERSON So you are basically, though, relying on these 
local auditors to determine whether they are within the 20 percent 
requirements, or 15, right? pcn-cui, 

Mr. Keilty. That's correct. 

Mr. Peterson. And you don't really have any way of going in 
and domg any testing on whether they actually are in compliance 
or not; you just take their word for it? 

Mr. Keilty We have had— you know, you get into the question 
of our oversight monitoring of the program. We have been doing a 
lot of oversight and monitoring of the system over the last couple 
ot years in the areas of procurement and on-the-job training 

In fact, our own staff visited and monitored, over the course of 
the d years of this extensive process, every single SDA in the Na- 
tion. 

Mr. Williams. We took staff from the State. We went in and we 
looked at procurement, we looked at their recordkeeping and re- 
porting, we looked at on-the-job training, and required specific cor- 
rective actions in every case where we found a problem, and dis- 
allowed costs or referred special areas where we found problems, 
reierred that to audit. 

Mr. Peierson. Do you have a handle on the people that are 
doing these audits? I mean, my limited experience is that I think 
there are probably a lot of people out there doing these audits that 
wouldn t know if these costs were appropriate or not. 

1 don t think they have the training to know— even if they could 
use the auditing techniques to find out the information, I'm not 
sure they would know whether these are administrative costs or 
not. Would you disagree with that, that there's a fair number of 
them that 

Mr. Keilty. I don't know "fair" number. It's a good thing the in- 
spector general isn t here. I've had concern about the quality of the 
contract auditors the inspector general uses on doing some of his 
own audits. So yes, that and the issue of whether the Single Audit 

Mr Peterson Do you think that has been helpful? Do you think 

that the Single Audit Act 

Mr. Keilty. Well, it's good 

Mr. Peterson [continuing]. Has accomplished anything' 

Mr. Keilty. No. I mean ^ 

Mr. Williams. No. One of the things that we've constantly raised 
questions about is the need for more financial audits; and, indeed 
weve worked with the inspector general where we've seen specific 
areas we felt needed to be audited, and asked for specific audits 
because that s one of the problems with the Single Audit Act It 
only picks up, in some cases, a very few transactions within our 
area. 

So we've had to ask for more specific financial audits in those 
areas where we are monitoring and showing that we have reason 
to be concerned about the audit process there. 

Mr. Peterson. There is, I think, a requirement that they are 
supposed to look at whether there is compliance with the regula- 
tions, right? Do you think that is really happening, to any extent? 
Do you think that they actually know enough to know what 
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Mr Williams. Well, there are certainly a number of cases where, 
between the monitoring and the audit, there are cases that come 
up to us for resolution or for further investigation or further audit- 
?ng and there are not only corrective actions t«ken administratively 
but there are dollars repaid to the Treasury based upon those dis- 

^"srSnly there is activity that is ongoing But I think it is fair 
to say, and I think the IG would agree with this, that it is of un- 
even qiSity, and I would agree wTth your comment on that We 
find s6me, £th in terms of the people who do it under contract for 
the IG and also the people who are doing it at the local level. 

There"s an unevelTness. Despite devefopment of audit pides, de- 
spite training, despite increased retraining, there is still some un- 

'^Mr" DA^V^But the rules and the amendments now provide for 
a much more explicit delineation of what the cost categories are 
and what^s to be charged. We've provided defensive training to the 
States aUldy on financial management. There is a technical as- 
sSance Se that is going to be developed and issued. So we are 
woS| I? making sifre t^at costs are properly charged and ac- 

'X'^pI™' d'o yo"u work with the State, and the American 
InSute and State societies of CPA's? You are working with the 

^*M? ^ILUAMS. I think there are a couple of things that are ongo- 
ing Certainly, the IG, in their own activity, the inspector general s 
office works with all of those organizations. . . 

We also meet frequently with-in fact, Mr. Davies just recentW 
came back from a meeting where he was talking about Je a^^^^^ 
ments— meet frequently with people who are the JTPA auditors, 
assodations that work only on our activity or primarily on our ac- 

Mf' PETERSON. You are involved in helping to train tbose people? 

Mr Williams. We are involved with ©cchanging ideas with those 
oeoDle giving them information, training, answering their ques- 
Sons New amendments, in fact, that was the key to Mr. Davies 
oresentation out there, to talk about the amendments, their im- 
S *e tightening of the definitions and the. charging to the cost 
categories, and to be available to answer questions. 

We frequently meet with that association, but also with individ- 
ual JTPA auditors who have difficulties or need questions an- 

"^Mr^PETERSON. The inspector general called for more oversight. 
Do you have the resources to comply with that, reabsticaUy^ 

Mr Williams. The inspector general's office talked with us in 
Augist of lasTyear and looked at the issue specifically of ^ers'g^t 
ani looked at a situation in terms of our own plans, and indicated 
?hat Tver a 2.ye;r period, it would be helpfu if we fiad some addi- 
tionaUtoff that could be trained and moved into oversight activity. 

M7^fe:iLTY. Mr. Chairman, in point of fact in our 1994 budget 
reSst to the Congress, the Assistant ^^^'^jy'f'J'^^^Zd 
budget calling for additional staff resources for ETA to be usea, 
partially because of the JTPA amendments and also because of the 
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economic investment package that the President had included but 
clearly, within the budget itself, a recognition that because of the 
JTPA amendments, more resources were required in ETA, not only 
people but travel and all sorts of resources that we would need to 
do that job. 

Mr. Williams. Clearly, what we did 3 years ago, was we utilized 
staff in all of our regional offices as well as the national office, and 
even diverted some staff from other activities to do the very in- 
depth review that we did on procurement and on-the-job training, 
recordkeeping, at every one of the service delivery levels. 

That is very difficult on not only the staff, but on the system, be- 
cause they are forced to move from other activities but it in fact 
did get a number of corrective actions in the system, and I think 
it helped train the States further in terms of how to go about some 
of the monitoring activities in a more aggressive fashion. 

I heard some discussion earlier today about passivity, and I can 
assure you that many of the people at the local level thought that 
there was anything but passivity when we were going out and try- 
ing to work to correct some of these problems. 

Particularly in the pr»>curement area we found that to be nec- 
essary, and we v/orked in two ways. We worked with the States 
and the service delivery areas on the reviews but then we also 
went back and worked with them on the corrective actions and on 
the technical assistance, so the problems, hopefully, would not 
occur again. 

Mr. IjaVIES. You asked a question earlier in the hearing about 
the role of the States. There are two principal things that we de- 
pend on States doing. One is to administer the program. An essen- 
tial part of that is to carry out oversight. 

We have done a number of things to be much more directive with 
the States about what their responsibility is for administration 
and, in particular, the oversight, 

Mr. WILLIAMS, The Governor is specifically charged with certain 
annual reviews and certifications as to written procurement sys- 
tems and other recordkeeping processes to be in place. 

Ml Peterson. How is that done? Through the State auditors, or 
what? 

Mr. Williams. Well, through the Governors' own oversight staffs. 

Mr, PETERSON, Somebody on the Governor's staff? 

Mr. Williams. No, the people who are working in the JTPA pro- 
gram. We indicated earlier there were about 2.500 of those people. 
But they do, in fact, borrow from the State auditor's staff and from 
other people that they need in the State as well as ask our own 
people to go. 

Many of these reviews are done jointly, because there may be 
certain levels of expertise in certain areas — for example, in report- 
ing or accounting — where specific staff are detailed for the purpose 
of these reviews, 

Ms. Greene, And to add to that, you asked why we were not 
asking for this information directly from the localities rather than 
going to the States. The primary role of the States is to assess an- 
nually the performance of the local programs within the State and 
to reward, based on this performance data, those programs that are 
exceeding their standards. 
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They actually have a set-aside that is targeted for rewards for 
good performance. So it is the State responsibility to impose the 
performance standards, to assess program performance at the end 
of the year against those standards, and to reward those programs 
that are doing well and to provide technical assistance to those 
that did not meet their standards. So the States play an integral 
part. 

We would not want to circumvent that particular line or area of 
authority to ask for information that we would need, to look at 
local performance and to use our own evaluation purposes, because 
we used that data base to set the national standards and to de- 
velop new standards. We would want to have the States incor- 
porated in that process. 

Mr. Williams. I think States also help in the overall planning 
of their human resources services and the new human resources in- 
vestment counselor with broadly based representation is also going 
to help, I thinky in that planning and coordination of statewide 
human resources services, not just in the job training area, but 
generally in the State. 

I think, as was mentioned earlier today, there is also a role in 
terms of dislocated workers where there is a need for the State. It 
has some responsibility in terms of rapid response, and some con- 
tinued responsibility in working with unemployed workers at the 
statewide level and trying to train and find new jobs in emerging 
areas. 

Mr. Pf.TERSON. We are running overtime here. There is one more 
thing, and we will probably have some other questions that we will 
send to you. 

Mr. WILLLM4S. Yes, sir. 

Mr. Peterson. In terms of trying to take what works and expand 
it, and take what does not work and eliminate it, suppose you are 
working with the States — how does that all work? Are you basically 
leaving that up to the States as well, or do you have some strategy 
at the Federal level where you identify what is working? 

Mr. Davies. There has been an ongoing activity wherein we 
share results with the JTPA system through the Governors and 
through the various associations that respond to the system. But 
the 1992 amendments provide for a much expanded capacity build- 
ing activity in the JTPA system where training for staff and shar- 
ing of successful models will be carried out. States receive a portion 
of money to go toward that and the Department has a responsibil- 
ity for snaring those positive standards and positive programs. 

The most immediate thing that we are doing is, as a followup to 
the training on the basic regulations, going out and providing sub- 
ject-specific training on successful assessment techniques; youth 
models that seem to work, even though weVe struggling with that; 
case management; financial management; all of^the individual 
things that we think need to be understood to operate successful 
programs, including good model programs. 

Mr. WlLLL\MS. Thank you. 

Mr. Peterson. Thank you all very much for your testimony. We 
may be looking at this some more. But if you would be kind enough 
to answer, we may have a few questions we might submit to you. 
Keep us apprised of what you are up to over there. 
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Mr. Williams. Yes, sir. 

Mr. Peterson. We appreciate you being with us. 
Mr. Williams. Thank you, Mr. Chairman. Thank you for having 
us. 

Mr. Peterson. This subcommittee is adjourned. 
[Whereupon, at 12:45 p.m., the subcommittee adijoumed, to re- 
convene subject to the call of the Chair.] 
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I MM h«r« today to dltcust l.sutf InltUttd Dy th« Departatnt of U- 
boff inip^ctor rn*rdlnt th. Job Tranlng PartnTthlp Act, Thof 

fvn l..u«t 4r«, (1) Vh^tbT tht job pUc*««t prfomanc. «.4,ur« u.«d 
encouraft SDAt to work with th* ptrtlclpantt who nted th. Ua.t h«lp and 
pUc« thu In low-paying Jobs which they could h*v« obtained without attlt- 
tanca; (2) what th« long-t.m bw.flts 4r« to th« participant!; (3) whath- 
ar JTPA It concentrating on job placw-nt, which should b« tha rola of tha 
stata €«ploy«ant farvlcat, Inttaad of training; (4) whether JTPA funda are 
being used to subsidize local businesses who would hava hired som of tha 
same employees without the progran; (5) whether JTPA program are complying 
with their remedial education mandate; (6) whether youth In Sunaar Youth 
Programs are properly supervised for work output; (7) whether the 70 per- 
cent of the monies statutorily designated for job trelnlng are Instead 
being epplled to administrative costs; and whether the cost effectiveness 
of the programs can be meesured. 

First, I would like to give you a brief background of Rural Minnesota 
CEP (Concentrated Employment Programs). 

Rural Minnesota CEP, Inc, , a private non-profit organizatioQ incorpo- 
rated in 1968, operates employment and training programs uad«r tha Job 
Training Partnership Act (JTPA), The basic purpose of the orgaoixatioD is 
to provide job trelnlng and employment opportunities to economically disad- 
vantaged, unemployed and underemployed people. The goals ar« to incraasa 
tha client 's earned income, maxlmlw employment opportuolties. and anhanca 
self-sufficiency, Rural Minnesota CEP is uniqua among JTFA Service Dalir- 
ery Areas by virtue of its privata non-profit statu*. In 1973. vhaa CITA 
was passed, only four Rural Concentrated EmplopMttt Programs (dPs) vara 
designated CETA prima sponaors. Past accoa«>lishments and aAalnlstrativa 
capabilities were considered in the prime sponsor designation. Tha same 
considerations were used whan Rural Minnesota dP was daeignatad a JTPA 
service daliverer in 1982 (SnA2). IMdP is also a sarrica provider for tha 
JOBS Program and the federal dislocated worker progrM (KDVAA). 
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Rural Minnesota CEP is ona of aavantttn Sarvlca Dtlivary Araat r«c«lv- 
Ing f\indt undar tha Job Training Partnarthlp Act in Mlnnatota. Rural Miima* 
sota CEP not only adoiinlttara thasa fundt but also provldas tha farvlcat. 
Sarvlcas includa; Caraar Planning, On- tha- Job Training, Work Training, 
Lifa Skills, and Job Search. Adult Basic Education, Genaral Education 
Diploma Training, English as a Second Unguaga, High School Diploma and 
Post-Secondary Vocational Classroom Trsining ara provided to Rural Minneso- 
ta CEP clients through local education agencies. 

Rural Minnesota CEP works closely with State and County elected offi- 
cials as well as representatives of the three Indian reservations found 
within the area. Every program operated by the Agency is reviewed by tha 
private Industry Council which is comprised of local business people, educa- 
tors, economic developers and representatives of other agencies. A Board 
of Directors, whose members represent a wide cross-section of rural life, 
provides direction and guidance to the organization. 

In its 24 year history. Rural Minnesota CEP has managed over $228 mil- 
lion in private, county, state and federal funds, and provided employment 
and training services to approximately 133,600 unemployed, economically 
disadvantaged person*. In Program Year 1991, over SOX of the adolt partici- 
pants who left our Job Training Partnarihip Act Title IIA program fo«nd 
unsubsidixed employment. Other participants returned to achool. Joined tha 
military, or decided to continue in other training as a result of their 
•xparienca with Rural Minnesota CIP. Ovar 83X of the participanta in tha 
Youth Program entered employment or achieved a Youth Eaployability Enhaaca- 
Mnt outcome. The agency worked with over 9,300 participants in all of its 
program* in the Program Year ending June 30, 1992. 

The area served by Rural Minnesota CEP is Service Delivary Ataa 2. 
(Attachment A). The population density averagas only 20 people per s<iaara 
mile. Only four of the cities have a population over 10,000. Tha rural 
nature of the area creates a challenge for any job seeker, Low wages and 
unemployment ara typical in the SDA 2 area. The mediaa hourly wage it SSX 
of tha etata median hourly wage. The 1989 per capita ixicom ranged from 
balov $11,000 In Claarwmter Co«ity to ebova $17,000 la Travarae Coomtyi thm 



226 



$t.tt p€r cplta Inco^ va. $lg.73X. ft. SDA 2 unnplo^t r.t. W4. 6.7X 
In X992 coiip*r«d to t fm« un«jq>loy»tnt rtU of 5. OX. 

I«ttM li PEUOtKAHQC STAKDAim 

Ptrfor«*nc« ttandtrdt 4r« 4 m«4fur« of th* qumllty 4nd 4ccount4blllty 
of tht d4llv4ry of Mploymcnt 4nd trtlnlnf ttrvlcM. In th* prosr4m y«4r 
•ndlni Jun4 30, 1992 both th* St4t« of Mlnnwot* «nd Ilur4l mim4tot4 CIP 
4chi4V4d high p4rfom«nc«. Th4t4 outcoMt v«r« 4chUv*d b«c«u4« RMCEP and 
othar Mlnnesot4 SDAt offtr quality tarvlcet to 4II Indlvlduala. Tha out- 
co«»e of $260/we€k at follow-up for walfara reclplentt It contlderably abova 
tha $170/week an Individual working for tht «lnlna waga would aam. 



JTPA II-A 
PROGRAM YEAI 1991 
Parfonsanca Standards 

Stata 

Standard 



Follow-up Employaant Rate 
Walfara follow-up Baployment Rata 
Follow-up Waakly Earnlngt 
Walfara Follow-up Waakly Earnlngt 

Youth 

Entarad Eaploymant Rata 
Eiq>loyability Enhancaaant Rata 

Stata Parformanca Standards 

Adult t Youth 

Walfara Raclplantt Enrol lad 
As a Parcantaga of Total 
Cnrolla«nt 

Adult 

Waga at Placaaant Aa a 

Parcantaga of Adult Ron-Walfara 
Cli«ntt Waga at PlacMMnt 



60. 4X 
33. 4X 
$233 
$236 



49. 2X 
2g.2X 



49. 3X 



90. OX 



RMCEP 

Actual 

Perfomance 

7g.4X 
77. 3X 
$249 
$249 



73. 3X 
43. 6Z 



34. 8X 



96. XX 



Stata 

Actual 
Parformanca 

68. 2X 
63. 4X 
$266 
$260 



33. 3X 
43. IX 



38. 8X 



99. OX 



Thata outconaa vara achlavad whila tarvlng hard-to-tarva Individuals* 
Walfara racipiaots ara ona of tha groupa datignatad as bard-to-attrv* *-*^r 
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th« 1992 JTPA amendmentfl. Walfart racipUnts mada up 38. 8X of tha JTPA IIA 
participantt in FY 1991. Currently 70X of RMCEP't adult participantt fit 
into ona or nora of the hard to serva categories included in tha JTPA aaend- 
Bents. 

Rural Minnesota CEP's policy it to serve econoeically disadvantagad 
individuals who need assistance to obtain employnent. Rather than fit 
people into boxes, staff look at need. «iotivatiou end cownitment with an 
emphasis on need. 

Issue 2z LONG TERM BENEFITS 

Individuals who participate in RMCEP's Employment and Training Program 
realize several benefits. 

o Adult participants who left the program for employment In Program 
Year 1991 were paid $260 per week when surveyed for follow-up 
data. As a starting wage this compares favorably with average 
weekly wages of all employees in tha nineteen counties of Ser- 
vice Delivery Area 2 which ranged from $289.89 per week to 
$386.93 per week In the fourth <iuarter of 1991. 

o Of those participants who left the program for employment. 88. 9X 
were still working thirteen weeks later according to survey re- 
sults. 

o Participants who complete Class roca Training or On- the- Job Train- 
ing have marketable skills that will help them secure and advance 
on a job. 

o Participants who complete Vbrk Training gain basic work skills 
and habits that will help them succeed at any Job. 

o Participants In the Life Skills Workshop are better able to cope 
with pressures that could force them to <{uit wording. 
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o Participants in basic education, G£D« BSt and High School DlploM 
PrograiM Increasa thalr confldenca and thalr ability to access 
furthar adticatlon and training opportunities. 

Individuals would hava fraat difficulty In achieving any of these 
long*lastlng results If not for the help and assistance available through 
the Job Training Partnership Act. 

Issue 3t JTPA TtAnilMG AMD PLACEMEHT ACTIVITIKS 

In Minnesota Job Service and Service Delivery Areas negotiate coordina- 
tion agreements which Include a description of the services which each 
entity will provide. (Attachment 2) 

Rural Minnesota CEP'i charge Is to provide training, employment experl* 
ence and employablUty planning services to economically disadvantaged 
unemployed people who have barriers to employment. Ttie nlsslon of the Job 
Service Is to bring people and jobs together by helping businesses meet 
labor force needs. 

The Rural MlnnesoU CEP Eaployablllty Development SysteM conslsU of a 
series of organized activities which pronote a fonul and practical ap- 
proach to help participants secure employment. The activities In which 
clients participate are determined by the coapletloa of a Needs Assess- 
ment. The Heeds Assessment provides staff with the Information nectssary 
to evaluate the employment related needs of the client. During the Heeds 
Assessment, staff determine the skills, abilities, training, work history 
and employment barriers of each client. After determining neadi, an indi- 
vidual may enter one of the following activities t 

1. Career Planning System — This component %ras developed to instrt*ct the 
disadvantaged unemployed in making informed career decisions. The 
process considers aptitude, skills. Interests, lifestyle needs, person- 
el barriers and labor atrket possibilities in setting career goals. 
The result of the activity is a written Employability Development Plan. 
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2. Work Trtinlnf S<mm *pplic*nti hav* n«irtr h«ld « Job or h4v« an 
inconsist«nt work history. Work Training it for them. Participantf 
ara placed in well-supervlsed workiitef to leem bailc eiq>loyMnt 
skills such as promptness, cooperation with co-workers, responsibili- 
ties to employers and dependability. 

3. Youth- In-Tran»itlon This activity consists of short term and/or 
pmrt-tlme Jobs for clients who are In school. It provides sttidents 
with an opportunity to develop basic work skills while completing 
their education. 

4. On- the- Job Training Participants learn specific Job skills in an 
actxial work situation. The employer provides the training and Rural 
Minnesota CEP reimburses the employer for extraordinary training 



trained to specifications. 

3. Adult Basic Education Participants who require upgrading of reed- 
ing, communications and math skills are enrolled In adult basic educa- 
tion programs operated by local school districts. 

6. General Equivalency Diploma Dropouts prepare for the GED test with 
local education agency providers. 

7. High School Diploma -- Participants work toward a diploma ia a local 
altamatlve education center, alternative program or regular high 
school program. 

8. English aa a Second Lang;iage — Individuals whose primary language is 
not English participate in ESL classes through local educetioa agen- 
ciea. 

9. Classroom Training Occupational akill clmssroom inatmctioQ ia also 
evailable to participants in cooperatlom with exiating poat-secoadary 
schools. Tuition, books, and suppllea are provided hy turel Minnesota 
dp. Supportive aenrlcss ar« alao evsilablm. 



The worker gets a Job and the employer gets an employee 
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10. Job Search Systea — This three %«ek training activity includtt a five 
day workshop in which participants are taught how to access the hidden 
job market for job openings, prepare a good resuae, perfom well at 
interviews « keep a job once they get it, leave a Job that is not work- 
ing out, and start the process again if necessary. Staff then wmitor 
the irapleoentation of these skills for two weeks. RMCEP thus gives 
people the lifetijM skills for staying employed. 

11. Life Skills Many hard-to-serve clients lack the confidence and 
knowledge necessary to deal with the complexities of modem society. 
In Life Skills participants leam techniques to take control of their 
personal lives. This activity includes sections on personal growth, 
stress, self-esteem, positive thinking, trust, eloneness, values, 
change, decision making, budgeting and parenting. Helping individuals 
gain control of their lives improves the likelihood that they will 
stay employed. 

12. Youth Competency System -- Youth are screened in three areas t Pre-Em- 
ployment/Vork Maturity Skills, Basic Education Skills and Job Specific 
Skills. Should the initial screening in<Aicate that a youth say be 
deficient in an area, further evaluation is conducted using CASAS 
pre-assessnent instruments. Youth who require upgrading in two of the 
three competency skill areas participate in the Youth Competency Sys- 
tem. A plan is developed outlining Rural Minnesota CEP activities In 
which participants can obtain those skills* Any or all of the activl* 
ties described previously might be utilized* Youth are awarded Certif* 
icates of Competency for each of the three skill areas in which they 
reach a satisfactory level of performance as determined by the CASAS 
post-assessment. In the Pre-Employability/Vork Maturity Skills area, 
that level Is defined as achieving the eleven core competencies. In 
Basic Education Skills youth who test at or above the eighth grade 
level are considered competent. In Jo> Specific Skills, youth moat 
obtain at least 90Z of the skills needed for the job. 

13. Supportive Services are provided to participants on an as-needed ba- 
sis. These could include, but not be limited to testing fees, llcens* 
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Ini, child C4rt, trwitportatlon, approprlitt clothing, toolt and ftxb- 
^iltt«nc« n«ed«d to continue In training or obtain taploywant, 

Wtalla tha Job Saarch Syttaa and Job Placaaant ara options, thaj ara 
normally utlllsad by participants who hava co«q>latad som othar activity 
such as Classroom Training. Participants who ara Job raadj, wfaathar allgl* 
bla or not, ara rafarrad to Job Sarvlca for Placaatnt Sarvlcas. Sacvlcas 
provldad to participants In tha Job Search Systaa and Job Placaaant activi- 
ty ara unavallabla through Job Sorvlca In Sarvlca Dallvary Araa 2. A limit* 
ad nunbar of aconomically dlsadvantagad individuals who nead tha training 
offarad in tha Job Saarch System to find a good Job, may ba anrollad in 
that activity only. In PY1991 only 75 of 2,396 participants vera in J36 
only, while in PYX992 only 3A of the 1,781 participants served to date hava 
been in JSS only. Also, a small number of economically disadvantaged indi-> 
vidxials vfao hava a real need for supportive services for items such as 
clothes, tools, or relocation assistance in order to become employed may be 
enrolled in the Job Placement activity only. 

Over 73Z of our current program participants have received services in 
2 or more activities during this program year. Over AOX of the partici- 
pants in only one activity have been in Classroom Training, OJT or Work 
Training. This is in addition to a Needs Assessment and participatioci in 
the Employablllty Development System. This is an increase in service lev- 
els from PY199X. 

The increase has occurred as tMCSP has begun to move to providing more 
services to harder- to- serve individuals in response to state and federal 
mandates and priorities. IMCEP is concerned that prohibition on providing 
stand alone Job search will leave a service gap. People who have skills 
and need Joba aay not be able to find good employment because they do not 
know how to look for work. The economically disadvantaged are isolated and 
lack tha connections others uaa to secure good Jobs. Even gradoatea of 
post -secondary institutions and experienced workers flounder because they 
lack Job seeking skills and connections. Row sad it is that somaone comld 
remain disenfranchised because they lack clothing for work, tools, transpor- 
tation or ralocatioQ asslstanca* Oodar new regulations, BMCtT will ba 
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un4bl« to Stttvt thest Individuals until afttr tbty hmvt b€C<MM hard- to* 
serva and requira costly intarvantion rathar than cost-affactiva pravantion. 



During this prograa yaar. Rural Minnesota CEP, Inc. contractad with 
187 local businessas to train and aaploy 263 p*opla. On an avaraga, this 
is 1.4 contracts par cmployar. Last yaar w« coQtractad with 2S2 csployars 
to placa 311 OJT trainaas which avaragas to 1.23 contracts par aaployar. 
Tha aaployar nust contribute SOX or nora of thft OJT trainee's wages, pro- 
vide the sane benefits as available to other employees, and accept responsi- 
bility to provide specific training as designed in the contract. 

Va do not use OJT as frequently as we use classrocM vocational train- 
ing for our participants because it is time intensive to design and aonitor 
a custooiized training prograa. However, some of our participants have sore 
success in this direct hands-on training activity and participants are 
inaediataly earning e wage. 

OJT trainees are closely aonitored to assure that they are learning 
tha Job tasks as outlined in tha contract and that sufficient interventioo 
has occurred to address Mjor barriers to Maintaining eaployMttt* Cood 
client service practices encourage us to work with employers vbo are will- 
ing to invest in training and who are sensitive to the needs of the popula* 
tioQ which we serve. Ve have a provision to not pay contracts when train* 
ing has not been delivered as designad. Bacaosa our job developers nala* 
tain relationships with aaployers in specific areas, we are able to identi* 
fy eaployers who have a problea retaining OJT trainees. Administrative 
ovarsite, record keeping and follow-up statistics also assist «s to voxk in 
partnership with employers who are seeking long tern benefits fron the 
investnant in hunan capital rather than a short-tem econonic boost* 



In 1987» tural Minnesota CI? assenbled m task force of Mnbers fron 
the Private Industry Coaocil» adnlnistratioo anA teachers fron local edsca- 



Issue At Oa-THS-JOB TEAINIJIC GONTRACTS 



Issue 5s tmrniAL IDOCATIOK MAKKUTI 
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tion districts, and tnpIoym«nt *nd training ptrsotmal to davalop goldalinas 
for a litaracy prograa. Utaracy Training is an anrichjaant prograa da- 
signad to pravant tha losa of grada laval of tan axpariancad by "at-risk* 
youth during tha sunmar Bonths. As part of thair work weak, youth in this 
conponant racaivad ranedial instruction in aath and reading, Tha SuMMr 
Youth Litaracy Training Prograa has operated for the past six rears. 

Local school districts provide Literacy Training under contract with 
Rural Minnesota CEP. Youth are identified by the local schools aa in need 
of Literacy Training based on academic performance or standardized test 
scores which indicate that the student is functioning below 8th grada coope- 
tency or at two grade levels below an age appropriate level. A pre and 
post test is aditinis tared to provide documentation of program effort. 

Last suBiner, Rural Minnesota CEP, Inc. contracted with 32 school dis- 
tricts and cooperative educational districts to provide remedial education 
in reading and math. Those school districts and teachers that participated 
in Summer Youth Literacy Training provided excellent and often innovative 
instruction in Mathematics and reading. Their efforts and coonitment 
helped make this Sumeer Youth Program successful. 

Prograa success in average gains in literacy levels are as notedt 



Year 


^Participants 


Reading 


Math 


1992 


339 


.S9 


.98 


1991 


327 


1.12 


.83 


1990 


317 


1.0 


.9 


19$9 


314 


.9 


l.l 


1988 


174 


1.1 


.36 


1987 


130 







* The Quabers of youth participating In Literacy Training is a combine* 
tioQ of IIB and MY7. 



This indicates a slight gain, but aore ij^rtantly» the scores indi- 
cate that thtt prograa ii succesafol ia its objective to aaintaia grade 
lev«l. In additioot S9X of the youth ia the prograa last aiMaer raceived 

academic credit* - 'j^ > -^i- . 

- f • ' i^,- • 
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turtl Mlnn«sota Ctf h«s Md« contltttnt tffort to M«t tht rtmdltl 
•ducation needs of tht youth in training with us for tht futurt workforct. 
In tddition to tht ftdtrti suMtr progra., rtsourctt vtrt provldtd by tht 
Stttt fundtd Mirmtsota Youth Program* 

Issut 6 1 smSM. YDCriH PKOGBIAM SOPERVISIOB 

Rural Minnesota CEP operatts t quality SusMr Youth Program. Vt accom- 
plish this because vt set tht valut In training tht staff ptoplt vho will 
bt tht contact parson for tht youth and tht worksitt supervisors. In turn, 
RMCEP summer staff provide training to worksitt supervisors on program 
goals, regulations, safety, and mentoring. Sunner staff also provide tht 
youth participants with an orientation to the world of work. Included in 
this training is an eaphasis on meaningful work. 

Ust sumaer, participants in tht Stunner Youth Program were plactd at 
worksitts which were wtll supervised and provided meaningful work. 
Worksites wtrt devtloptd primarily with government and non-profit enti- 
ties. Evtry tffort was madt to assurt that youth had an opportunity to 
apply for jobs within thtlr sphtrt of interest and ability. Many of the 
Jobs also gave youth an opportunity to improve their cotMunltles* Thm 
communities in our rurel 19 county aree count on the youth workers to con- 
tribute their time end talents to conmmity improvement projects es crew 
workers or eides in: county and city perk depertmcnts. coamunlty recree- 
tlon programs, tourist information centers, senior nutrition centers, city 
street departments, county mcstumt and libraries, county and city govern- 
ment offices, locel schools, recycling centers, and natural resource agen- 
cies* Public sector jobs were fully subsidized* On-the-job Training con- 
tracts, which reimbursed the employer tq» to 30% of the wages for trelnlng 
coetJi Incurred were administered for private sector worksites* loth public 
and prlvete worksites helpmd youth develop skills and obtain sxperlence 
thet will prove Invaluable when they leevm school and enter thm workforce* 

lural Minnesota dP staff fre<ittently contacted both thm youth and 
worksite eupervlsor to essure our mission for the programt e safe and 
prodttctlv* work e3q>erleoce for th« youth* Protram closs-ottt . rMorU turn 
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th€ sivMMr ftaff caphMlted tht •xctll«iict In worksltt fuptrvltlon and 
conroended suptrviiori for thtlr dedication to young peopU. 

Work Training activity Is tht vthlcU for ona of our PIC racoonenda- 
tlons: encourage mentoring of youth participant!. The workilta supervl- 
son are encouraged to fom a Mentoring relationship with the youth. This 
concept Is introduced to the supervisors at a pre-placeaent training ses- 
sion. The Sufflner Youth staff program evaluations provided these observe* 
tlons about mentoring: 

"special effort that we made was to work with the supervisors in tenns 
of training them to be mentors to the youth. Many of the supervisors 
did a lot of this on their own and already saw It as one of their 
primary functions." 

"It was a pleasure for us to see the mentoring that was taking place 
at some of the worksites. Ve compliment these supervisors for taking 
the risk of assisting the kids in their personal life and teaching 
them skills and work habits that will enable them to succeed in the 
working world.* 

"I felt the majority of the worksites w«re excellant as w«ll as the 
supervisors being good role models as well as mentors. I had a great 
deal of youth clients talk favorably about their worksites as well as 
their suparvlsors." 

CoBBients from youth participants reinforce the value of the supervisor 
as mentor relationshlpt "I'm glad I got the chance to work for my supervi- 
sor. He was greatir -goss was cool, would like to work for him next 
suMer.* "It has made my life different.* 'Great worksite and supervi- 
sorsl** 

Our work training activity is flexible to aeet the naeds of the youth 
and the worksite supervisor. Flexibility is iaportant also to accomw>data 
the literacy needs of the youth. According to a sunmy ,retura«d by the 
youth p«rticip«nU la gyp lut tumMtt 
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71.33X wrktd full-tia* 

90% said that thair supervisor discussed safaty with thea 
96Z indicated that thara was anotifh work to keep tha« busy 
95.33X fait thair work was worthwhile 

77.33X of the youth were working in an environment where only 1 
to 3 youth were assigned to a supervisor. 



The low ratio of youth to supervisor, emphasis on safety, and meaning- 
ful work promotes an excellent youth program. 



Section 108 of Public Law 97-300 establishes the limitation of costs 
as follows: 



Section 108(d) of Public Law 97-300 exempts Concentrated Employment 
Prograas fro« these limitations. 

Although excapt froa JTPA cost lialtatioos, KMCCP has always striven 
to Met the goals established in the law. (See chart below). The difficul- 
ty of operating a good program which Mats federal re<(uireMnts with only 
liX of the budget devoted to atUnistration was acknowledged In the 1992 
JTPA aMndaants which now allow 20X, and in soaa Instances of the 

ftmds to be used for adalnlstration. 



Issue 7j FDHDS AND EFFECTIVENESS 



Administration 
Training 

Participant Support 



15. OX Maximum 
70.02 Minimum 
15. OX Maximum 
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T1ir«« Yt«r Coa^trlton of Cott C«tt|ori«t for UCCP 

It «Uoc«tln| SOX of Work Cxp«ci«nca «ip«nditar«t to th« TXAINXNC cost cstciory. 

Fitc«l Y«sr Endini Fitcal Y««r Endlni Fitcsl Y««r Endini 
JTPA Tltl« IX-A 6-30-90 6-30-91 6-30-92 TOTALS 



AdalnlttrstioQ 
Trftlnlng 
Part. Support 

Total 



JTfA TltU 

AdalalitrstioQ 
Trftlnlns 
Part. Support 

Tottl 



634.014 1S.9Z 

2,319.423 3S.0Z 

1,044.747 26. IX 

3.998.184 



634*014 13. 9Z 

2.703.611 67. 6Z 

660.339 16. 3X 

3.991. 114 



631.310 16. IX 

2.196.332 36. 6X 

922.061 2%.6X 

3.749.910 



631.310 16. IX 

2.331.393 67. 7X 

379.803 13. 3X 

3.749.910 



497.891 14. 9X 

1.970.113 39. OX 

869.477 26. IX 

3.337.483 



497.191 14. 9S 

2.264.133 67. 9X 

374.737 17. 2X 

3.337.413 



1.763.413 13. 9X 

6.413.170 31. 3Z 

2. 836. 292 23. 6X 

11.083.377 



1.763.413 13. 9X 

7.307.041 67. 7X 

1.113.121 16. 4X 

11.013.377 



Section 108(b) (2) (A&B) sUov« for th« sUocstion of 30X of work «xp«rl- 
tnc« «xp«ndltur«« to th« TKAIMINC co^ntnt If th« Work Exp«rl«nc« 1« Icsi 
th«n 6 Month*: prohibition fro« future Work Experience: thlf activity it 
coupled with other treinini ectivitiet; end the wages paid do not exceed 
the prevailing entry level wage rate. 

Allocating 30X of Work Experience expenditurei to the TlAlNlKG cott 
category. 

Fitcal Year Ending Fifcel Te*r Ending Fiscal Yeer Ending 
II-A 6-30-90 6-30-91 6-30-92 TOTALS 



JTPA it in accountable program. Independent audits performd by certi- 
fied Public Accountantt Are on file for tural MlnnetotA GIT'e progriae. 
The program is Also »oftitored by the State of Mlnnetot* end vrlttea docMea- 
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tttion it mainttined. Audit reports and Statt Monitoring reports art avail- 
ablt. 

Federal requirements vtiich contribute to the costs for administration 
include maintaining required audit, accoiinting, data collection, affirma- 
tive action, monitoring, grievance and other procedures which are not with- 
out cost* 

Still, as shown in the table below, all SDAs in Minnesota in the pro- 
gram ye»ar ending June 30, 1992 were within the limitations. Procedures for 
assigning costs have been approved by the State of Minnesota and their 
appropriateness verified by Independent audit of individual SDAs. 





State of Minnesota 




Total Expenditures 


15, 457,665 




AdmlniCration 


2,271,061 


1A.7X 


Training 


10,885,907 


70. 4X 


Support 


2,300,697 


U.9X 



Vhen considering cost effectiveness one would have to compare the cost 
of the investment in training to the coet of lost wages, welfare payments » 
lost taxes, unrealized potential, low«r productivity, end human suffering. 
Although I cannot analyze the costs of the latter I believe the investmenv 
in RMCE? JTPA clients of lese than $2,000 per participant is cost effective 
when compared to the costs of the alternative. 

JTPA/LGB 
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Pmrtidpant CTmracteristics 

Rural Mmnesou CEP h*s tn ongoing commitment to serving welfare recipi- 
ents. In PY'91 1,614 clients participated in the JTPA IIA Adult Program of 
whom 56. 9X were welfare redpienU. The JTPA IIA Youth Program had 7«2 
enrollments of whom 50. IX were welfare recipients. It Is estimated that 
10. 3X of the eligible population were receiving Public Assistance during 
the program year. Welfare rcdpicnts, however, made up 54.8% of the agen- 
cy's enrollment. Welfare recipieaU not only were enrolled at a onich great- 
er rate than their inddence in the eligible population^ but reqviired a 
larger proportion of the resources to be adequately served. Rxiral Minneso- 
ta CEP recognizes the needs of this hard to serve group, and will continue 
its commitment to make welfare redpients a priority for services. 



PARTICIPANT CHARACTERISTICS SUMMARY 
PY'91 IIA ADULT 4 YOUTH PROGRAMS 



Actual Planned 
Substantial Level of Level of 

Segments Service Service 



Female 


55 


OX 


50. OX 


b.-ok 


0 


6X 


0.2X 


Hispanic 


1 


» 


0.7X 


Native American 


n 


2X 


9.0X 


Asian 


0 


» 


0.4X 


w-n 


6 


2X 


6.5X 


U-21 


26 


7X 


24.9X 


22-39 


51 


IX 


51. OX 


40-54 


L3 


.9X 


14 .OX 


"55* 


5 


.IX 


3.6X 



Actual Planned 
Hard to Level of Level of 

Serve Service Service 



Adult Dropout 7.9X 13. OX 

Youth Dropout 4.6X 7.6X 

Food Stamp 51. 3X 30. OX 

St. Public Asiis. 54. 8X 50.0X 

AFDC 34.4X 31.5X 

Work Readlnc3s/GA 21-4X 18. 5X 
Refugee Cash Ass. O.OX O.lX 

UC Recipient 4.9X 4.6X 

HowIeM 1.6X 0.3X 

Handicapped 12. 9X 12. OX 



Loog-Tcra Unemployed 20. 3X 
Cbc«. Dependent 10. 2X 

Low R«d£ng Skms 7.9X 
Oftendert 10. 9X 

At Rljk Youth 17. 2X 



* Not Planned 
Inchidcs JTPA 3X Older Worker Program 



Appendix 2.--Questions for the Record, Submitted by 
Mr. Machtley 



COMMITTEE ON ARMEO ScRVlCCS 
COMMITTEE ON SMALL f.SINESS 
COMMITTEE ON OOVERNMEN" OpERATIOHS 




COMCMIUiOn*!. nUMu MiOKn lAua 
COHCMdtlONAl TiniVf CAiCUl 



^ Congress of the Hnited States 

i^ou5e of Ueprescntatiocs 
^Dashington, 20515-5901 



Kay 18, 1993 



The Honorable Collin C. Peterson 
Chairman 

SubcoBunit^ea on E^nployment, Housing, and Aviation 
B-349 A Rayburn House Office Building 
Washington, DC 2C515 

Dear Mr. Chaiman: 

ThanX you for calling the April 29 hearing to review the Jor 
Training Partnership Act. I found the testimony from the witnesses 
very revealing and I look forward to continuing ::he subcommittee's 
oversight of federal job training programs. 

Enclosed please find a copy of a letter I vrote to Secretary 
of Labor Robert Reich which contains questions I would like tc 
Labor Department to answer for the hearing record. I would alsc 
like to have this letter and the Labor Department's reply submitted 
for the official hearing transcript for the April 29, 1993 hearing. 

Again, thank you for calling this hearing. I look forward tc 
continuing to work with you. If you have any questions regarding 
this letter, please contact myself or Mike Nanmjii at 5-9026. 




TMaciit 

Ranking Minority Member 
Subcommittee on Employment, 
Housing, and Aviation 
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COMMrTTEi OH AMMCO SERVICES 
COMMmXC OK SMALL tViSUIESS 

cOMMimc ON covcknmcnt operations 




£onartss of tht ^iritd States 

^mt of TltprtsnnnDts 
^Dastiington, BC ^j-nMqoi 



Kay 18, 1992 

% 

The Honorable Robert B. Reich 
Secretary 

United States Department of Labor 
200 Constitution Avenue, NW 
Washington , D.C. 20210 

Dear Mr. Secretary: 

Thank you for sending Deputy Assistant Secretary David O. 
Williams to appear before the Hossc Government operations 
Subcommittee on Employment, Housing, and Aviation to testify on 
behalf of the U.S. Department of Labor at the hearing held on April 
29, 1993. I appreciate the Labor Department's participation in 
this hearing and look forward to working with you in the future. 

In the written testimony submitted by Mr. Williams, he made 
reference to your efforts to conduct a review of Federal job 
training programs. Specifically, Mr. Williams' written testimony 
states, on pages 12-13, that "Secretary Reich is undertaking a 
review of Federal job training procr^s, including JTPA, to 
determine the programs and strategies that work and those that 
don't." 

In response to the questions listed below, please provide 
further information regarding your review for the April 29 hearing 
record. 

1) Describe in detail the scope of the Labor Departaent's 
"review" of federal job training programs. What specific 
programs are subject to the reviev? 

2) Have any working groups, task forces, or commissions of any 
type been created by the Labor department to conduct this 
review? 

3) If yes, please submit a list of all Leibor Department employees 
who work for or are assigned to thase groups, including their 
name, their title, and the division within the Labor 
Department to which they are assirr.ed. 

I 
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The Honorable Robert B. Reich — p.ge 2 

4) If the aforement joned groups .ia\2 been establis^.ed, are any 
non-federal or private sector persons assigr.ad to these 
groups? 

5) If yes, please submit a list =: all private sector persons who 
work for or are assigned to —ess groups, incluiir.5 their 
name, their title, and their ius:.ness address. 

6) If the aforementioned groups '.av2 been established, have you 
or any other Labor Departjsnt employee provided written 
guidance to the group(s)? 

7) If yes, please submit a copy = ar.y written guidir.ce provided 
to the group (r.) . 

8) Is this review associated v:-:n Vice President ?J±«rt Gore's 
National Performance Review? 

Please submit your response! ~o these questions by June 4, 
1993. If you have any questions regarding this request, please 
contact Michael Hannini of the sub=raE-_ttee at 225-9026. Thank you 
for your attention to this requesz. 




Rdn Machtlty 
Ranking Minority Member 
Subcommittee cn Employment, 
Housing, and Aviation 
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U.S. Department of Labor 



Ecnfto^mtci and Tratnori Adrrvti^strabon 
200 Constitution /WxA NW 
Wishmglon. DC 20210 




The Honorable Ron Machtley 
Ranking Minority Member 
Subcommittee on Employment, 
Housing, and Aviation 
U.S. House of Representatives 
Washington, D.C. 20515 

Dear Congressman Machtley: 

Thank you for your letter to Secretary Reich requesting 
information on the Department of Labor's review of federal job 
training programs. 

The Secretary is planning a thorough review of job training 
programs. However, these plans are still being formulated, and 
we do not knew at this point how the review will be structured. 
I will get back to you when the review plan takes shape and 
address your questions. 

Thank you again for writing to the Secretary. Please feel free 
to call me at 219-8660 if I can be of further assistance. 

Sincerely, 

RAYMOND J. UHALDE 
Administrator 

Office of Strategic Planning 
and Policy Development 

o 
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